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Systematic review of public health emergency operations centres 


Executive summary 


A public health emergency operations centre (EOC] is a central location for coordinating opera- 
tional information and resources for strategic management of public health emergencies! and 
events. EOCs provide communication and information tools and services and a management 
system during a response to an emergency or event. They also provide other essential functions 
to support decision-making and implementation, coordination, and collaboration. 


This systematic review examined peer-reviewed and grey literature in order to document global 
best practices for effective public health emergency response by EOCs; to identify indicators to 
monitor EOC performance; to describe risk communication in EOC settings; to outline research 
needs; and to identify standardised terminology. 


The standards and best practices identified will be used to strengthen World Health Organization 
(WHO) Member State capacity for effective public health response. Analysis of the components 
of EOCs and their standards and best practices can assist in achieving the basic EOC functions 
and navigating the complexities of emergency response. 


Several categories of EOC function were researched: general EOC function and structure; EOC 
communication technology and infrastructure; procedures and plans; minimum data sets and 
standards for operational information; and training and exercises. 


A total of 291 studies were examined, and recommendations and lessons learned from the 
peer-reviewed literature are incorporated throughout the report, organized by category. Stan- 
dards, guidelines, and best practices are listed in Tables 3 and 4 and referenced throughout the 
report. Certain qualities were consistently noted as important elements of effective EOC func- 
tion: collaboration; coordination; communication; harmonisation; respect; cooperation; vertical 
and horizontal integration; trust; and leadership [5.1.7]. Evidence that these elements are foun- 
dational components of effective EOC function spanned grey literature; peer-reviewed literature; 
quantitative and qualitative studies; and case studies of both effective and ineffective emergency 
responses. The literature showed that the biggest barriers to EOC function were lack of sufficient 
communication and coordination. Other impediments existed, and adequate planning was also 
an essential element, but communication and coordination consistently formed the basis for EOC 
SUCCESS, 


EOCs are used in a variety of hazards and emergencies, including natural disasters; foodborne 
disease outbreaks; radionuclear events; bioterrorism; chemical incidents; mass gatherings; blac- 
kouts; humanitarian emergencies; and disease outbreaks or pandemics. They are employed at 
a variety of jurisdictional levels, ranging from field EOCs to local or regional EOCs to national or 
international EOCs [5.1.2 and Table 2]. Staff and surge capacity were important elements of EOC 
function in all areas [5.1.3 and 5.1.4]. Incident Command Systems and similar EOC structures 
were frequently used to organize EOC operations and decision-making [5.1.5 and 5.1.6]. 


Incorporating lessons learned into EOC plans and function can improve performance. Several 
performance indicators are used to measure success, although clear agreement on indicators 


1 A public health emergency is an extraordinary event that adversely affects the health of human populations and which requires a co- 
ordinated response. Such an event may increase morbidity and/or mortality, and/or spread disease, and may be caused by natural 
disasters, disease outbreaks or pandemics, bioterrorism, radionuclear events, chemical incidents, humanitarian emergencies, etc. 
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is not seen in the literature. While no current international standards exist for monitoring the 
function of EOCs, several bodies, including WHO, the 2005 International Health Regulations 
(IHR(2005]), and the United States of America Centres for Disease Control and Prevention 
(CDC), provide performance measure indicators [5.1.8]. 


Best practices for building new EOCs and improving existing ones include recommendations 
about an EOC’s location and physical space requirements, as well as suggested information and 
communication technology components [5.2.1, 5.2.2, and 5.2.3]. EOCs, whether physical or vir- 
tual, also frequently use information and knowledge management software applications [5.2.4]. 
These systems are increasingly critical for sufficient communication within and between agen- 
cies and EOCs during emergency response. The need for backup systems and redundancies is 
also widely documented [5.2.3]. 


The need for plans is continually emphasized. This report lays out components and characteris- 
tics of an emergency operations plan, providing a suggested structure for plans and procedures 
[5.3.1 and 5.3.2]. The planning process, and that of conducting a hazard analysis or needs as- 
sessment, are also discussed as key steps [5.3.3]. 


Hisk communication is integrated throughout many other foci and categories in the literature. 
Accurate and timely information sharing that is evidence-based and coordinated is critical. Buil- 
ding on existing relationships and collaboration is particularly effective, both with the media and 
with other agencies and stakeholders [5.4]. Risk communication is an important component of 
emergency operations plans and EOC operations [5.4.1]. 


Operational information and information needs can vary widely in EOC settings, but needs as- 
sessments and the use of existing and baseline data are helpful to effective EOC function [5.5.1]. 
The types of operational information needed by EOCs and information sources depend on the 
type of hazard or emergency, but follow similar categories, outlined in Sections 5.5.2 and 5.5.3. 
These data, and the appropriate use of communication technology and systems, are critical to 
decision-making and response [5.5.4]. 


Training and exercises form an essential component of emergency response plans and stan- 
dards [5.6]. Individual training can improve the skills and competencies of EOC staff for specific 
EOC functions and for cross-functional and interagency skill improvement [5.6.1]. Organizational 
training and exercises are important both for team and relationship building and for the agency's 
ability to function effectively [5.6.2]. 


Future areas of research are recommended in Section 6.6 and include surveillance systems, the 
legal and ethical issues concerning EOCs, and more in-depth research on risk communication. 
Several review questions not fully supported by the systematic review are also recommended for 
future study. These include solutions to surge capacity; the challenges of using information mana- 
gement software; EOC training programmes; and integrating risk communication into exercises. 


Finally, international standards and/or guidelines need to be developed in order to: outline a 
structure for the organization of EOC operations and decision-making; delineate roles and res- 
ponsibilities for staff and surge staff, list appropriate knowledge management software and ICT 
in line with messaging, privacy, and security standards; list data collection, analysis, and inter- 
pretation processes and systems to be used; and develop consistent schedules and content for 
training and exercises. 
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71. List of abbreviations 


ACM 
ANSI 

BSI 
CASP 
CASPER 
CDC 
COPSS 
CSA 
DHS 
DOJ 
ebXML 
ECDC 
EMBASE 
EOC 
EOC-NET 
FEMA 
GCR 

GIS 

HL7 
HTTP 
IASC 
ICD-10 
ICS 

ICT 

IEEE 

IEEE Xplore 
IHR 
INFOSAN 


ISO 


Association for Computing Machinery 

American National Standards Institute 

British Standards Institution 

Critical Appraisal Skills Programme 

Community Assessment for Public Health Emergency Response 
United States Centers for Disease Control and Prevention 
Common Operating Picture Software/System 

Canadian Standards Association 

United States Department of Homeland Security 

United States Department of Justice 

Electronic Business Extensible Markup Language 

European Centre for Disease Prevention and Control 
Excerpta Medica Database 

Public Health Emergency Operations Centre/ Center 

Public Health Emergency Operations Centre Network 
United States Federal Emergency Management Agency 
WHO Department of Global Capacities, Alert and Hesponse 
Geographic Information Systems 

Health Level 7 International 

Hypertext Transfer Protocol 

Inter-Agency Standing Committee 

International Classification of Diseases, 10 revision 
Incident Command System 

Information and communication technology 

Institute of Electrical and Electronics Engineers 

Digital library of the Institute of Electrical and Electronics Engineers 
International Health Regulations 

International Food Safety Authorities Network 


International Organization for Standardisation 








LOINC 


MACS 


NFPA 


OASIS 


OCHA 


OSOCC 


PAHO 


PHIN MS 


PKI 


PRISMA 


PROSPERO 


PubMed 


SNOMED 


SSL 


UN 


WHO 


World Health Organization 


Logical Observation Identifiers Names and Codes 

Multiagency Coordination Systems 

National Fire Protection Association 

Organization for the Advancement of Structured Information Standards 
The United Nations Office for the Coordination of Humanitarian Affairs 
On-Site Operations Coordination Centre 

Pan American Health Organization 

Public Health Information Network Messaging System 

Public Key infrastructure 

Preferred Reporting of Items for Systematic Reviews and Meta-Analyses 
International Prospective Register of Systematic Reviews 

Public/ Publisher MEDLINE 

Systematized Nomenclature of Medicine 

Secure Sockets Layer 

United Nations 


World Health Organization 
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2. Introduction 


2.1 Background 


The World Health Organization (WHO) Department of Global Capacities, Alert and Response 
(GCR) established the Public Health Emergency Operations Centre Network (EOC-NET) in 2012. 
This was done in order to strengthen global collaboration and WHO Member States’ capacity for 
effective public health all-hazards response in line with the requirements of the 2005 Internatio- 
nal Health Regulations (IHR{2005)). 


A systematic review was undertaken in order to: provide understanding of the current global 
status and best practices of public health emergency operations centre (EOCs); document impe- 
diments and gaps; and inform the development of guidance and standards for building, main- 
taining, and using EOCs for response to public health risks and emergencies. This systematic 
review aimed to address the components of EOCs and their standards and best practices both 
for achieving the basic EOC functions and for navigating the complexities of emergency response. 


2.2 Review objectives 


1. Inform WHO and EOC-NET partners of the current status, gaps, and impediments in build- 
ing, maintaining, and using EOCs 


2. Share global best practices for EOCs for effective public health emergency response 
3. Describe the connection between EOCs and risk communication 

4. Identify indicators to monitor performance of EOCs 

5. Outline research needs for building, maintaining, and using EOCs 


6. ldentify standardised EOC terminology. 
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3. Methods 


3.1 Summary of review questions & categories 


A public health emergenoy operations centre (EOC] is the central location for coordinating ope- 
rational information and resources for strategic management of public health emergencies and 
events. EOCs provide communication and information tools and services and a management sys- 
tem during a response to public health emergencies and events. They also provide other essen- 
tial functions to support decision-making and implementation, coordination, and collaboration. An 
EQC is often referred to by other names (1). 


Categories of possible hazards or risks included in this review include disease outbreaks or pan- 
demics (e.g., influenza, haemorrhagic fever, meningitis, cholera, smallpox, polio, dengue fever, 
plague, emerging infectious diseases]; bioweapon or bioterrorism events; crises or disasters; 
chemical safety or toxicology events; radionuclear safety events; food safety events or outbreaks; 
mass gatherings; and others. 


Review questions were grouped into five categories (Section 8.1): 


1. General questions 

2. EOC communication technology and infrastructure 

3. Procedures and plans 

4. Operational information minimum data sets and standards 


5. Training and exercises. 


3.2 Review protocol 


The review protocol followed the guidelines of the Preferred Reporting of Items for Systematic 
reviews and Meta-Analyses (PRISMA), the Cochrane Handbook for Systematic Reviews of Inter- 
ventions, and the WHO Handbook for Guideline Development. It specified the review's objectives, 
search strategy, inclusion and exclusion criteria, data extraction methods, and quality assess- 
ment. The protocol was registered in the PROSPERO International Prospective Register of Sys- 
tematic Heviews [2-4]. 


3.3 Study identification 


3.3.1 Exclusion and inclusion criteria 


All articles published in English between 1 January 1993 and 30 October 2013 that contained 
both an abstract and full text were included. The abstract requirement was waived for govern- 
ment and industry reports and other grey literature sources. Articles selected for inclusion used 
strategic 


> ແ 


various terms to refer to an EOC (e.g., “command and control operations centre, 


health operations centre," "command centre, 
To be included, an article must have provided information relevant to one or more of five pre- 


situation room" and “crisis management centre’). 
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determined review categories (general; information communications technology infrastructure; 
procedures and plans; operational information minimum data sets and standards; and training 
and exercise). These categories were developed by WHO and Emory University. 


Duplicate articles and those with interventions and/or programme descriptions occurring be- 
fore 1 January 1993 were excluded. Figure 1 shows the number of records identified during the 
retrieval process and how many were excluded because they did not meet the criteria detailed 


here. 


Figure 1. Workflow diagram of the retrieval process for the systematic review of public 
health emergency operations centres, January 1993 — October 2013 





6401 records identified through 432 records identified through 
searching PubMed, EMBASE, Web searching other sources 


of Science, IEEE Xplore, and ACM 


4502 records after duplicates removed 
117 records 
4502 records screened not in English 
excluded 


40894 articles 

4385 articles screened for inclusion excluded for 

criteria (relevance to review questions and inclusion and 
review scope) exclusion 


criteria 
291 studies and documents included 
in data extraction and quality assessment 


3.3.2 Publication types 


Original peer-reviewed articles, review articles, standards, guidelines, and government and indus- 
try reports were included. The types of documents found included descriptive studies and those 


using qualitative methods of data collection and analysis. 


Identification 
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3.3.3 Search strategy & data sources 


Exhaustive searches were performed collecting all relevant studies, standards, and reports avai- 
lable during the study period. The following databases were searched: PubMed, EMBASE, Web 
of Science, IEEE Xplore, and ACM. The following grey literature sources were also searched: 
WHO, the United States Centers for Disease Control and Prevention (CDC), academic research 
centres, and the Pan American Health Organization (PAHO). PubMed was searched first; sub- 
sequent search strategies were derived from PubMed outcomes and modified for each data- 
base. The initial search informed the subsequent search of the grey literature, which included 
websites of partner organizations and published standards. 


A parallel search was conducted in PubMed using additionally identified terms and syntax to 
identify unique references in order to ensure all relevant articles were included. Five hundred 
and sixty five references were identified. After applying the inclusion criteria, no additional stu- 
dies were included in the final review. The full search strategy can be found in Section 8.2. 
The reference lists of reviews or articles found during the search, or which were known to the 
authors, were also searched (a technique often called snowballing). 


During the search and study selection process, four investigators independently screened and 
selected studies for possible inclusion. First, titles and abstracts of studies, standards, and re- 
ports identified were independently reviewed and pooled for further screening. Second, each 
reviewer examined the abstracts of the studies, standards, and reports identified in the title and 
abstract screening process. Each reviewer compiled a list of studies, standards, and reports 
that met the inclusion criteria. 


A second investigator then compared each list; disagreements were resolved by discussion 
and consensus on studies included and excluded. Final studies, standards, and reports selected 
were then stratified by category. Some of the final studies, standards, and reports selected were 
eligible for more than one category, but data extraction and quality assessments were perfor- 
med only once. 


3.4 Data extraction & management 


After conducting the search, results were exported to an independent database. All the refe- 
rences were merged, and duplicates were identified and removed. Heferences were managed 
using EndNote®. 


The four investigators independently extracted data using a standardised data collection instru- 
ment developed on Google Drive& using Microsoft Excel&. The following elements were collec- 
ted: 


W Setting (country and year] 

B Aim/objective 

m Study design 

W Evaluation method 

ສ Type of hazard, risk, emergency, or event 


W Size of population served/ studied 
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m Qualities, components, jurisdiction, and functional capacity of centre 

m Standards, requirements, or guidelines included or noted 

m Adverse events, challenges, or barriers 

m Outcomes, lessons learned, after action report conclusions, best practices 
m Recommendations 

m Limitations (study & outcome level) 

m Dias 


B Generalisability. 


Assessment of the qualities, components, jurisdiction, and functional capacity of the EOC included 
information about whether an EOC was public or private; temporary or permanent; operational 
and at a city, state, national, regional, or local level. It also included the funding source; the chain 
of command and/or level of oversight; staff size; and the types of public health emergencies to 
which the EOC was able to respond. 


Additional information, where relevant, was extracted in order to include any regional, national, 
or international EOC standards in use or recommended, as well as their implications for practice 
or policy. 


3.5 Quality assessment 


The data and the studies’ outcomes were evaluated. Because most studies did not fit the quality 
assessment standards of clinical quantitative research, the Critical Appraisal Skills Programme 
(CASP) (5) was used to evaluate the research based on the following criteria: 


1. Relevance to review objectives and review questions 
2. Clarity of the research question 

3. Appropriateness of the study design 

4. Sampling 

5. Data collection 

6. Potential for bias 

7. Higour of data analysis 


8. Clarity of results. 
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4. Results 


4.4 Quality assessment analysis 


Studies that were more generalisable were given a higher quality rating than those that were not 
generalisable. Generalisability in this review meant the ability of a study's findings to be applied 
to other circumstances, emergencies, events, and EOCs. Studies were scored "yes" or "no" for 
generalisability, or, when certain quality assessment measures were not applicable, a "not appli- 
cable" score was assigned. 


Many studies included in this review were articles using neither quantitative nor qualitative re- 
search methods. Hather, they were case studies, peer-reviewed versions of after action reports, 
retrospectives of emergency response situations, or governmental reports. For example, docu- 
ments that retrospectively examined an EOC's response during a particular emergency and des- 
cribed the challenges and lessons learned did not contain data collection or analysis, and there- 
fore could not be evaluated according to these measures. In instances like these, the document 
was given a "not applicable" score for data collection and analysis methods. Each article was 
evaluated on the basis of relevance, appropriateness of study design, analysis methods, clarity of 
results, and generalisability when applicable. 


> ແ 


A "COUNTIF" formula in Excel was used to calculate the number of “yes,” “no,” and "not applicable" 
responses in each criterion, and their corresponding percentages (Table 1). Based on these 
results, only the criteria for which less than 5096 of responses were "not applicable" were kept: 
clarity of research questions, appropriate methodology, clarity of findings, and generalisability. 
The data analysis criterion was also kept, as this is an important marker for those studies that 


included data analysis. 


Table 1. Quality assessment process results of studies yielded from the systematic 
review of public health emergency operations centres, January 1993 — October 2013 


Quality assessment response 


Not applicable 


Criterion Yes (9^) No (96) (94) Total 

Clarity of research question 209 (72) 22 (8) 60 (21) 291 
Generalisability 202 (69) 37 (13) 52 (18) 291 
Clarity of findings 185 (64) 21 (7) 84 (29) 291 
Appropriate methodology 136 (47) 15 (5) 140 (48) 291 
Appropriate research design 109 (87) 17 (6) 165 (57) 291 
Data collection 89 (81) 18 (6) 184 (63) 291 
Data analysis 65 (22) 29 (10) 197 (68) 291 
Appropriate sampling 58 (20) 11 (4) 222 (76) 291 


Researcher bias 27 (9) 34 (12) 230 (79) 291 
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Because a sum of the "yes" responses and a traditional summary of findings table would not 
accurately portray study quality and would inappropriately weight the "not applicable" responses, 
a quality ratio was calculated for each study, and an overall mean quality ratio was derived. Qua- 
lity assessment responses for the five criteria (clarity of research questions, appropriate metho- 
dology, clarity of findings, and generalisability) were coded. “Yes” responses were coded 1, “no” 
responses were coded O, and "not applicable" responses were not coded. These scores were 
summed to produce numerators for each study; "not applicable" responses were not included in 
this numerator, as they were not given a numerical score. 


To calculate the denominator, the "yes" and "no" responses were summed. "Not applicable" 
responses were excluded from the denominators so they would not artificially weight the ratio 
scores. The numerator (the sum of all coded "yes" and "no" responses) was divided by the deno- 
minator (the total number of applicable criteria, maximum 5) to produce ratio scores for each 
study. A score of O would indicate that a study had all “no” responses for the applicable quality 
assessment criteria and was of low quality. Likewise, a score of 1 would indicate that a study 
had all "yes" responses for the applicable criteria and was of high quality. Ratio scores for the 
291 included studies ranged from O to 1, with a mean of 0.87. This mean indicates that, in the 
context of a possible "perfect" ratio of 1, the overall quality of the included studies was very high. 


4.2 Characteristics of identified studies 


A total of 291 studies were included in the review (Table 2). 202 (6996) were from the peer-re- 
viewed literature and 89 (3196) were from the grey literature. Some studies were characterised 
into more than one review category, jurisdiction, or type of event during the data extraction pro- 
cess. The most frequently reviewed categories were general (157); procedures and plans (124); 
and operational information minimum data sets and standards (1 1 6). 


The national level was the most common jurisdiction (123), although many studies did not specify 
a jurisdictional level (72). Many articles (162) were about general emergency response. Of those 
specifying a type of hazard, most dealt with disease outbreaks (43) and disasters/crises (29). 
Not all included studies are referenced specifically in this report, but all may be found in the list 
of additional studies, standards, and other materials in Section 8.3. 


4.3 Identified standards 


Standards exist at local, national, and international levels to provide consistenoy in the building, 
maintenance, and use of EOCs. Serving as guides or requirements, standards are created by 
bodies including the American Society for Testing and Materials (ASTM) International; the Ame- 
rican National Standards Institute (ANSI); the British Standards Institution (BSI); the Canadian 
Standards Association (CSA); the InterAgency Board; the Institute of Electrical and Electronics 
Engineers (IEEE); the International Organization for Standardisation (ISOJ; the National Fire Pro- 
tection Association (NFPA); and the Organization for the Advancement of Structured Information 
Standards (OASIS) (Table 3]. 


Systematic review of public health emergency operations centres 


Table2. Characteristics of the studies yielded from the systematic literature review of public 
health emergency operations centres, January 1993 — October 2013 





Type of study Peer-reviewed Grey Total 
(n=202) (n=89) (n=291) 
Review category ` General 109 48 157 
Procedures and plans 79 45 124 


Operational information minimum 





data sets and standards ee ee ie 
rn technology and infra- 72 10 82 
Training and exercise 40 18 58 
Jurisdiction National 84 39 123 
Regional 63 19 82 
Local 61 18 79 
International 21 32 53 
Field 14 6 20 
Not Specified 44 28 72 
Other 4 0 4 
Type of hazard, General 99 63 162 
risk, or event Disease outbreak 34 9 43 
Disaster/Orisis 28 1 29 
Bioweapon/Bioterrorism 12 0 12 
Radionuclear event 11 1 12 
Mass gathering 6 1 7 
Chemical incident 4 0 4 
Foodborne disease outbreak 1 3 4 
Not applicable 5 26 31 
Other 2 2 4 


Standards help establish global criteria for emergency response facilities and equipment; bu- 
siness continuity programmes; data exchange; communication systems; incident management 
systems; risk management; assessment exercises; and responses to specific types of emergen- 
cies [6-12] (Table 3). 


Large governmental bodies responsible for emergency operations, such as the European Centre 
for Disease Prevention and Control (ECDC) or the United States Federal Emergency Manage- 
ment Agency (FEMA), recommend standards developed by other organizations, such as ASTM 
or CSA. Along with standards, governments and organizations rely heavily on guidelines and best 
practices to inform their work (Table 4). This review lists standards in Table 3 and guidelines and 
best practices in Table 4. Recommendations and lessons learned from the peer-reviewed litera- 
ture are referenced throughout the text but excluded from the table of standards. 





Table3. ` Standards applicable to the building, maintenance, and use of EOCs 





ASTM E2601 - 08 Standard Practice for Radiological Emer- 
gency Response 


E2668-10 Standard Guide for Emergency Operations 
Center (EOC) Development 


E2770 - 10 Standard Guide for Operational Guidelines 
for Initial Response to a Suspected Biothreat Agent 


ANSI INCITS 398-2008 Information technology - Common 
Biometric Exchange Formats Framework (CBEFF) 


BSI PAS 200:2011 Crisis management. Guidance and 
good practice 


CSA Z1600-08 - Emergency Management and Business 
Continuity Programs 


IEEE 1512 - Family of Standards for Incident Management 
Message Sets 


ISO 11064-7:2006, Ergonomic design of control centres — 
Part 7: Principles for the evaluation of control centres 


22324, Societal security - Emergency management — 
Colour-coded alert 


22322, Societal security - Emergency management — 
Public warning 


22320:2011, Societal security - Emergency manage- 
ment — Requirements for incident response 





22398, Societal security — Guidelines for exercises and 
testing 


PAS 22399:2007, Societal security — Guidelines for 
incident preparedness and operational continuity x x x 
management 


11320:2011, Nuclear critical safety - Emergency 
preparedness and response 


31000:2009, Risk management - Principles and guide- 
lines, for the development of emergency preparedness x 
plans and processes 


IEC 24762:2008 Information technology - Security 
techniques — Guidelines for information and communi- x x 
cations technology disaster recovery services 


IEC 27031:2011 Information technology — Security 
techniques — Guidelines for information and commu- x x x 
nications technology readiness for business continuity 


NFPA 1600 Standard on Disaster/Emergency Management t 
and Business Continuity Programs 2013 Edition x X 5 ^ 
1561 Standard on Emergency Services Incident 3 " S 
Management System 2008 Edition 
1221 Standard for Installation, Maintenance, and Use S 
of Emergency Services Communications Systems 
OASIS Common Alerting Protocol Version 1.2 x 
Emergency Data Exchange Language (EDXL) Distribu- x 


tion Element, v1.0 
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Systematic review of public health emergency operations centres 


5. Discussion 


5.1 General 


5.1.1 EOC functions 


There are several basic functions of an emergency operations centre. As mentioned in the pre- 
vious paragraph Guarantelli outlines six: coordination, policy-making, operations, information ga- 
thering, dispersal of public information, and hosting visitors (15). Formal EOC structures such as 
Incident Command Systems (discussed below) organize EOC functions into sections that include 
operations, planning, logistics, and finance/ administration (17). Media and risk communication 
and maintenance of formal liaisons with other agencies are also basic EOC functions (18). Public 
health EOCs may add public health-specific functions including but not limited to surveillance 
monitoring, public health data collection and analysis, quarantine, epidemiology and laboratory 
functions and community mitigation (17, 19-21]. Quarantelli notes that there are many types of 
EOC structures, but that: “what is crucial is that... [staff] be knowledgeable and possess certain 
decision-making responsibilities" (22). The importance of coordination, communication, manage- 
ment, and information gathering and interpretation are consistent themes throughout the litera- 
ture (16, 23, 24). Modern technology, complex organizational and governmental structures, and 
insufficient resources are challenges to achieving Quarantelli’s six functions. 


5.1.2 Types of risks and hazards 


EOCs are used in a variety of hazards and emergencies. In some instances, EOCs are used for 
drills and exercises or other non-emergency events (25). In emergency situations, EOCs are 
activated due to: natural disasters; foodborne disease outbreaks; radionuclear events; bioter- 
rorism; chemical incidents; mass gatherings; blackouts; humanitarian emergencies; or disease 
outbreaks or pandemics - as discussed above and in Table 2. The literature cites protocols of 
the 2005 International Health Regulations (IHR(2005]) when discussing disease/ event detec- 
tion, and WHO pandemic global alert phases when discussing EOC activation under pandemics 
(86, 27). EOCs are used in multiple types of jurisdictions, taking forms ranging from field EOCs to 
local or regional EOCs to national or international EOCs (Table 2). 


5.1.3 Human resource needs 


While there was reluctance to quantify the number of staff needed for an ECC, given its variance 
according to jurisdiction, type of hazard, and duration and scale of emergency, the literature did 
suggest necessary competencies of EOC personnel. Staffing was described as "one of the most 
critical components of an EOC" (28). Some papers concluded that professionals staffing an EOC 
should have a clear set of responsibilities and expectations based on their disciplines (29-32), 
and should be well trained both in general emergency response and in their assigned responsi- 
bilities (33, 34). Others stated that there should be staff in place for all EOC functions, including 
leadership and management, operations; information management, logistics; media; safety and 
security; administration; technology support; and liaison (31, 32, 35]. 
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5.1.4 Surge capacity 


In public health EOCs, surge staff are needed for all EOC functions (15, 36). Identifying surge staff 
and adequately training them is "paramount to ensur[ing] capacity for an available and trained 
workforce... [that can] rapidly adapt to different and unfamiliar work patterns" (37). The United 
Nations Office for the Coordination of Humanitarian Affairs (OCHA) maintains an emergency 
response roster of 35 staff permanently available if an urgent response is needed; it also has 
several programmes to identify surge capacity staff in a variety of roles on short notice (38). It 
was noted that some public health professionals do not view themselves as emergency response 
personnel and therefore are not prepared for around-the-clock preparedness, or for a role within 
an EOC (89); this makes training all the more important for an effective EOC. 


5.1.5 Structure 


The organizational structure of EOCs was mentioned more frequently than physical and staf- 
fing needs. The literature showed a strong preference for an Incident Command System (ICS] 
(17-18, 25, 30, 35, 40-48). 


An ICS is a management system used by public health as well as law enforcement, emergency 
medical services, fire departments, and other bodies that coordinate response activities within a 
common framework. ICS uses an Incident Commander who leads response activities with a staff 
with several sections: command, operations, planning, logistics, and finance/ administration (49, 
50). ICS has many benefits, including a clear command structure, common terminology, the abi- 
lity to vary the precise structure and goals of the system depending on the situation, the ability to 
accommodate multiple protocols, and the ability to function in complex responses (40, 45, 51). 


The use of ICS within public health settings is relatively recent, and some public health agencies 
have adopted a modified ICS, such as that used during the 2009 H1N1 influenza pandemic 
(17). Public health EOCs often include a strong scientific and technical component, which is not 
traditionally emphasized in ICS (17, 30). Because public health professionals are not traditionally 
familiar with ICS terminology and structure, several studies recommend ICS training for staff in 
order to overcome this documented challenge during emergency response in EOGs (89, 52-54). 


Even when ICS is not used, an EOC’s structure is expected to be defined, standardised, scalable 
and flexible, and connected to other levels and agencies. Some papers indicated a need for 
clear “trigger points” to indicate decision-making, information sharing, or the need to involve 
other jurisdictions (86, 42, 48, 55); others made the point that this structure should be well 
understood by EOC personnel and should include liaisons from other organizations and agencies 
(18, 21, 28, 56, 57). 


5.1.6 Decision-making, modelling, and implementation 


Decision-making is a critical function of EOCs. Rapid but accurate decision-making is extremely 
difficult, however, as "in the early phase of an accident, there is very little time to make decisions" 
(58). Authoritative decision-making and EOC leadership were noted as factors in effective res- 
ponse, and a lack of leadership and decision-making were noted as significant challenges (59-65). 


Systematic review of public health emergency operations centres 


The literature suggests that proper preparedness and planning can be an important decision- 
making tool, as it allows operational decisions to be made under conditions less open to the 
irrationality and stress of a real-time emergency situation (48, 58, 68). The components and 
process of developing detailed plans are outlined below. 


The literature also notes the importance of sufficient and accurate information for decision- 
making in order to mitigate “the intense constraints of time and resources" under which EOCs 
must take action (B7). In situations without adequate information, it is difficult to take action and 
prioritize scarce resources (35, 48, 59, 60, 68). Ensuring enough information is gathered and 
then communicated in the right ways can facilitate decision-making. Effective decision-making 
can therefore be the product of effective planning and an effective EOC structure (69). 


Decision support systems and modelling can aid EOC leaders and decision makers, if used with 
the understanding that models are not always perfect and do not always predict accurately (58, 
70). Decision-making authorities can use data visualization tools such as GIS to help collate and 
interpret information to aid decision-making (48, 71, 72). Some EQCs use frameworks such as 
the Haddon or the Synchronization matrices to analyse a situation and provide practical solu- 
tions for response (42, 73]. 


Modelling can be used as another tool to aid the EOC decision-making process. While the out- 
comes of a model depend on the inputs, and model design is crucial, simulation and mathema- 
tical modelling can be used to explore consequences and capabilities of EOC actions (74-77). 
It is also important to supplement modelling with practice in order to integrate the model with 
the decision-making to follow (42, 78). However, the right information and model can provide 
"actionable information to decision makers... by helping to identify and prioritize areas" during 
emergency response (72). 


Having clear leadership and incident commanders, as part of an ICS or similar structure, is bene- 
ficial in making easily implemented and operationalized decisions. Many EOCs and emergency 
operations plans have triggers that lead to information sharing between EOC sections, with other 
EQGs, and with agencies (55). EOCs with standardised roles, a defined structure, and well-trained 
staff provide a formal process for taking action, thereby creating an environment in which neces- 
sary actions can be carried out (20, 42, 56). The process of implementing decisions and giving 
instructions to EOC staff, as well as that of reporting and receiving instructions from EOC leaders, 
can be detailed in EOC procedures (48]. 


5.1.7 Best practices 


Several features were consistently noted as crucial elements of effective EOC functioning. These 
included collaboration; coordination; communication; harmonisation; respect; cooperation; ver- 
tical and horizontal integration; trust; and leadership (24, 28, 31, 36, 40, 48, 63, 66, 67, 79- 
102). These features spanned the grey and peer-reviewed literature; quantitative and qualitative 
studies; and case studies of both effective and ineffective emergency responses. 


Communication was considered “a vital component" of response (86, 48, 79-82). Timely infor- 
mation sharing and exchange was noted as informing effective public health decisions and poli- 
cies (83), being essential for taking action (67, 84), and as the "main function of EOCs" (40). 
Notifying other agencies of an event's occurrence, a case of disease, or a public health emer- 
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gency of international concern is, of course, a requirement internationally (26) and within many 
countries (28, 85], but timely information sharing can also be more informal. Factors such as 
EOC planning, information technology, and EOC structure and procedures can affect the ability to 
share information (66, 86-89). However, setting the foundation for plentiful and timely informa- 
tion exchange can facilitate effective and rapid EOC action and response (90-93). 


Coordination with others within the organizational structure and at other agencies is touted as 
critical in emergency responses, during which information changes rapidly. Early and frequent 
coordination are repeatedly noted as key factors in an effective response (48, 63, 82, 94, 95). 
As Scanlon says bluntly: 


“An EOC is an effective way to achieve coordination among agencies responding 
to a major emergency or disaster. The absence of an EOC seems to encourage 
the opposite.” (96) 


Some have formalized the process of coordination, even going so far as to structure regionali- 
zation and partnerships (24, 97-100). Internationally, the International Search and Rescue Advi- 
sory Group developed guidelines and a concept for an On-Site Operations Coordination Centre 
(DSOCC) to improve international coordination (31). Others noted the need to coordinate with 
other sectors, including the private business sector (101), the healthcare sector (102), and the 
non-governmental organization sector (48, 82]. 


5.1.8 Indicators and performance measures 


There is no agreement in the literature about indicators to measure the performance and effec- 
tiveness of EOCs; development of indicators and metrics was lacking (33, 63, 103). Beck et al. 
report that "there is a growing need to coordinate and systemize [efforts] to ensure a consistent 
level of response" and that "there is a clear need for international standards" (63). Nelson et 
al. point out that the development of standards and accompanying indicators will be difficult "if 
'evidence-based' implies the standards of proof that are normally required for clinical and other 
public health interventions" (78). Though welcomed in principle by decision makers, standards 
can also pose challenges for those whose work uses language and approaches that vary from 
the language and approaches of the relevant standards (14). 


Many studies examined previous events and the performance of various EL Ce and their strengths 
and weaknesses; these results have been incorporated throughout this review. Indeed, some 
note that the incorporation of lessons learned into a jurisdictions emergency operations plans 
is more than simply recommended, but is in fact a critical component of the post-event phase. 
The Canadian Emergency Management Framework includes continuous improvement and both 
incremental and transformational change as key principles and "underlying beliefs and goals" 
of the Canadian perspective on emergency management (100). The target capabilities of the 
United States Department of Homeland Security (DHS) explicitly include the evaluation of plans 
based on lessons learned from both exercises and actual events (49); and one of Hebmann's 
key findings was that "examining past disaster responses and incorporating lessons learned into 
future disaster plans can improve public health preparedness" (52). 


Several examples of this improvement process were seen in the literature. North Dakota incor- 
porated lessons learned from past disasters, and improved procedures, staffing, and materials 
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(104). Sri Lanka established a Centre for National Operations to coordinate responses after the 
2004 tsunami (105). New Zealand incorporated lessons learned from a pandemic influenza 
exercise into its Influenza Pandemic Action Plan, which was subsequently activated, and the re- 
cent exercise was credited with the effective response (106). Capacity building activities underta- 
ken after ineffective hurricane response in North Carolina led directly to effective communication 
and better response after subsequent hurricanes (107). 


Nevertheless, there are some objective indicators of success. The United States Nuclear Regula- 
tory Commission provides guidance for emergency action levels for nuclear plant drills and emer- 
gencies (108). The Sphere Handbook includes key indicators for coordination and collaboration 
during humanitarian disasters (13, 70). Furthermore, the IHR core capacities for response state 
their use as indicators to monitor EOC response. The core response capacities include the requi- 
rement for functional command, communication and control mechanisms; rapid support for the 
investigation and control of emergencies; availability of a rapid response team; and development 
of policies and procedures. Indicators of these capacities include a dedicated operations centre; 
dedicated multidisciplinary rapid response teams; communication and collaboration during res- 
ponse; existence of guidelines and procedures; and response team training and security (109). 
The CDC's funding to state and local jurisdictions specifies performance measures and, in some 
circumstances, performance targets. Time for staff to report for EOC duty, development of an 
incident action plan, and completion of after action reports and improvement plans are included 
as performance measures, along with specifications on how to collect data, but these measures 
are not universally applied and nor are the accompanying performance targets (110). The WHO 
Emergency Response Framework has performance standards against which it measures its 
performance. Time-based performance standards are laid out that commit VVHO to taking cer- 
tain actions within predetermined timeframes. For example, WHO mobilizes existing staff to form 
an Emergency Response Team within 12 hours; establishes and delivers emergency services 
within 72 hours; and provides technical assistance as required within seven days - along with 
many other actions to ensure an effective response (111). 


5.2 Communication technology and infrastructure 


5.2.1 EOC space 


The physical locations of EOCs vary widely. In some cases, EOCs are located in a dedicated space 
(e.g. the CDC's EOC) (112, 113). More common are multi-purpose spaces that are converted 
into an EOC when needed. It is suggested that EOCs in multi-purpose locations must be able to be 
converted and activated within one hour (113). Modular EOCs can be shipped to any location and 
set up on (for example) a football field, a quality which is advantageous for providing open vertical 
access and proximity to evacuation centres (114). The United States DHS recommends that all 
states (i.e. provinces or regions), all counties, and all cities with populations over 50,000 have at 
least one designated EOC, and in most cases a backup EOC as well (115). 


Hegardless of the type of location, the literature recommends that EOCs have standard compo- 
nents. Co-ocations for essential interdependent functions are recommended for planning and 
operations, and logistics and finance (113). A separate communications centre is also a com- 
mon feature of EOCs (116). Some papers concluded that these facilities should have the ability 
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support robust communications systems featuring networked computers, telephone/fax lines, 
and display boards, along with backups for these systems (16, 92, 113]; and that the facility 
should also feature backup systems for electrical power and heating/ air conditioning (113). It is 
important that EOCs feature separate meeting rooms for priority discussions, along with a brie- 
fing space for visitors and the media (32, 113]. Lastly, a common component of EOC facilities is 
a staging area for air and land transportation (1 14). 


5.2.2 Information and communication technology (ICT) 


Rapid changes in information and communications technology (ICT) mean that studies published 
in the 1990s about technology used in EOCs are now far outdated. There is a wide range of 
ICT, software and hardware components and systems that support EOC functions; these are 
increasingly important (117-119). These systems allow EQCs to collect, analyse, interpret, visua- 
lize, and disseminate information accurately and quickly, providing a "significant preparedness 
and response advantage" (120). 


EOCs need data collection, analysis, and interpretation systems, communication systems, and 
knowledge management systems (70). Details of software, equipment, and systems are outlined 
below; but just as important as the specific systems are their shared characteristics. The lite- 
rature suggests that ICT must be interoperable and reliable, with backups in place; and it must 
be well designed and modifiable. Different elements of ICT must also use common vocabulary 
and terminology, in order that they are able to link with each other. Finally, staff using ICT must 
be trained and familiar with the systems, so that their use and implementation aids emergency 
response instead of hindering it (B, 43, 49, 67, 113, 121-125). The importance of these cha- 
racteristics, and especially that of interoperability, is underscored by Gusty, who points out that 
the lack of interoperability can make "accessing life-saving critical data impossible for emergency 
managers and incident commanders” (126). 


5.2.3 Equipment and technological components 


Basic hardware is an essential foundation of the proper function of ICT in an EOC. Such equip- 
ment includes servers; computers meeting the appropriate system and performance require- 
ments; high speed internet; and networking connections. An EOC should also have the ability to 
adapt its ICT capabilities if additional functionality is needed. Security is also a key concern, and 
the need to protect ICT against physical and cyber attacks is noted (127-129). 


Communications components are especially critical. The literature recommends that EOCs 
contain an adequate number of telephones and fax machines with secure connection capabili- 
ties. Video teleconferencing is commonly found in EOCs, for the purposes of communicating with 
those in other locations and agencies; and many EOCs also have computer messaging systems 
for rapid and informal staff communication within and among agencies (although mobile phones 
are also used for this purpose). EQCs commonly use video displays visible from throughout the 
main room in order to display multiple feeds for video conferencing, GIS and other visual data 
analyses, and maps. ICT tools are also used for communicating with those in the field; these tools 
are most commonly mobile and satellite phones and radios, although laptop computers and 
more extensive technologies are sometimes also used (16, 49, 59, 62, 68, 82, 104, 129-132]. 
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Backup and redundancy requirements are also thoroughly noted. The literature repeatedly em- 
phasized the need for backup systems and security requirements to ensure EOCs remain func- 
tional even if initial systems experience glitches or fail completely. Backup options are important 
for systems as well as equipment - such backup might include having radios on hand in case 
telephones are not operable. It is also noted that backup systems and redundancies can be 
implemented incrementally to balance costs and operational needs. It is pointed out that in the 
event of multiple systems failures, often “the technology that [works] best [is] the oldest" (128). 
Paper and pens and in-person communication can be relied on as the ultimate backup system 
(9, 49, 67, B8, 92, 104, 113, 122, 129, 133). 


5.2.4 Information and knowledge management software 


The volume of data and information available and used in EOCs can be daunting. Knowledge ma- 
nagement systems are a commonly used way to increase and improve information exchange in 
EL Le Systems can be custom built or purchased. Software systems mentioned in the literature 
include Responder Knowledge Base; DisasterLAN; E-Team; WebEOC; SharePoint; AskMeEnter- 
prise; Common Operating Picture Software/ Systems (COPSS); WIISARD; and wikis (48, 51, 67, 
133-137). 


Multiagency Coordination Systems (MACSs] coordinate activities both in the field and in EOCs, 
and prioritize demands for resources (89). MACSs can formalize the process of multiagency 
coordination by using specific protocols, often within an ICS structure. MACS can provide sup- 
port and coordination as well as assistance towards policy decisions; they can also facilitate infor- 
mation sharing between EOCs (93). The goal of a MACS is fully to integrate emergency response 
organizations, agencies, and structures (138-140). 


5.2.4.1 EOC applications and standards 


The review suggested that systems should adhere to internationally accepted standard messa- 
ging specifications and vocabularies, including HL7, LOINC, SNOMED, and ICD-10O; and that they 
should also use security standards such as ebXML, HTTP, PKI, PHIN MS, and SSL (121). 


The systems themselves can range from early warning and detection systems (133, 141) to 
geographic information systems IG) and spatial modelling (72). GIS systems were frequently 
mentioned as a way in which to display data visually to aid in decision-making. These visualizations 
are especially important for the public and stakeholders whose functions are less technical and 
scientific in nature (16, 49, 71, 120, 142-145). 


5.2.4.2 Virtual EOCs 


The ability to manage information and data through electronic systems is an indispensable com- 
ponent of the modern EOC; some agencies have advanced this concept to incorporate a virtual 
EOC into their responses. 


The concept of a virtual EOC is the creation of a virtual environment to support core EOC func- 
tions and enhance knowledge management, inter-organizational communication, collaboration, 
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and decision-making (148, 149). It is recommended that virtual EOCs use emergency manage- 
ment software; provide remote access to databases and communications; disseminate informa- 
tion; and link individuals and groups who are not in the same location, in order to help improve 
EOC function (147). Virtual EOCs can also take advantage of shared resources and system capa- 
city (127). 


Virtual EOCs can be used to access EOC data and communicate with EOC staff electronically 
(1, 99, 118). Virtual EOCs can also be used to allow agency staff or other organizations and 
agencies to participate remotely in EOC activities; to facilitate external communication; to share 
information with partners and stakeholders; and to document information and processes (WHO 
2012 consultation meeting; DHS/ DOJ Fusion Center, ASTM standard guide]. 


Some jurisdictions may decide to use a virtual EOC as a backup ‘location’ (146). A United States- 
based organization, Virtual Emergency Operations Center, operates completely in the cloud, 
collecting and disseminating information and providing support to field personnel (147); and a 
private sector EOC exists in the United States to coordinate the efforts of the public, private, and 
non-profit sectors (101 ). It is clear, however, that these models are not widely used. 


5.3 Procedures and plans 


5.3.1 Key characteristics of procedures and plans 


The literature unequivocally supports emergency operations planning: well-written plans can 
result in timely and effective implementation of response activities (106). Such plans "[should 
be] as simple as possible but as complex as necessary" (58). Having a plan does not, however, 
guarantee that an agency has achieved preparedness (150, 151). 


Plans must by definition be developed in advance. It is widely recommended that development be 
evidence-based, and the result of a coordinated effort involving multiple stakeholders and parties 
(33, 36, 49, 152-154] it is also recommended that plans consider multiple phases of emer- 
gency response, mitigation, preparedness, and recovery, in order comprehensively to address 
emergency preparedness (22). 


Plans frequently use an all-hazards approach that is comprehensive and which encompasses 
common response components that are needed across all types of hazards. The United States 
National Response Plan uses this approach to establish a plan “across a spectrum of activities” 
as well as across different types of emergencies (22, 44, 82, 100, 155, 156). Despite the popu- 
larity of the all-hazards approach, some of the literature cautions that plans should correspond 
to a jurisdiction's risk (48, 100, 157-159). 


The literature includes a wide variety of planning guidance, from nationallevel plans like the 
United States National Response Plan to guidance that local jurisdictions “should not be expec- 
ted to develop and coordinate cross-jurisdictional planning... better carried out by a centralized 
command structure at the state level” (160). 


Coordination with other agencies’ plans and resources is an important component for juris- 
dictions to consider (29, 33, 88, 150, 158, 161). The literature suggests that incorporating 
formal protocols for interacting with other agencies, jurisdictions, and sectors should be part of 
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all plans (29, 152, 153); and that agencies should also consider that plans will be affected, and 
sometimes superseded, by other jurisdictions that participate in EOC activation and emergency 
response (160, 162). 


5.3.2 Key components of emergency operations plans 


The literature suggests that emergency operations plans should have several standard compo- 
nents: the basic plan; functional annexes; hazard-specific appendices; and standard operating 
procedures and checklists (163). 


The basic plan is a high-level overview document that explains general concepts and assigns 
broad responsibilities. It cites legal authority for the response as well as the leadership structure. 
Some papers conclude that the basic plan should also state the general goals of the plan and list 
key EOC positions and their primary responsibilities; and that this section should give an overview 
of the planning process and the intentions to maintain and re-evaluate the plan (36, 154, 163). 


Functional annexes are organized around providing detail on specific functions of the EOC, inclu- 
ding detail on broad tasks, processes, roles, and responsibilities. Functions include but are not 
limited to direction and control; communications; warning; emergency public information; evacua- 
tion; mass care; health and medical services; and resource management (30, 154, 163). 


Hazard-specific appendices provide unique operational information for specific types of hazards. 
Information may include specific detail about procedures, protective action, and public informa- 
tion needs for particular hazards that are not addressed in the functional annexes or anywhere 
else in the plan. These appendices may list vulnerable populations or high-risk areas, warning or 
detection systems, evacuation or mitigation and control strategies, and unique planning conside- 
rations for a hazard (49, 154, 163). 


Standard operating procedures and checklists provide the most detailed step-by-step informa- 
tion about how individual staff should fulfil responsibilities and perform tasks. These responsibi- 
lities cover activities throughout the EOC's activation period and identify who should complete a 
given task, when it should be done, and how it should be done (82, 36, 48). 


Finally, plans also include a number of miscellaneous components, including a map of the EOC 
layout; contact lists of EOC personnel; standard forms for documenting EOC activities; training 
and exercise schedules and plans; and a section about de-activation and de-escalation pro- 
cedures (36, 113). 


5.3.3 Planning process 


Planning is time consuming, and agencies can find it difficult to address a range of hazards 
comprehensively. Focusing on the process of planning is as important as the plan itself (22, 33, 
36). It is also necessary to address operational problems as well as the necessary training and 
implementation preparations that must accompany plans (33). Although preparedness planning 
is a detailed and difficult process, the literature suggests that agencies should take advantage of 
the experience and plans of others, and should also consult national standards (36, 154). Addi- 
tional experiential knowledge is gained from incorporating lessons learned from previous EOC 
responses and training exercises into plan development (58, 84, 106). 
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Several sources recommend conducting a hazard analysis or needs assessment to identify what 
the plan should address (49). A needs or risk assessment can help an EOC know what type of 
hazards are most likely to occur, thereby guiding the planning and training processes (164-166). 
Hesults of such assessments and analyses can also inform decisions about the level of need for 
personnel, equipment, and other resources. Mass gatherings are one example of an event for 
which response will vary widely based on need; a small mass gathering of a short duration will 
require a smaller EOC, or perhaps none at all, whereas a larger, longer gathering or event will 
require a more robust EOC response (164). 


5.3.4 Activation criteria 


Some jurisdictions have protocols specifying when to activate EOCs (36, 40, 167], while others 
use an action committee or other authority that determines when to activate it (30, 48, 60, 95, 
106, 131, 146, 168-170). Depending on the situation, the degree of EOC activation can range 
from partial activation to full activation for a prolonged period of time (171). 


5.4 Risk communication 

Risk communication is a broad discipline, the literature for which contains vast amounts of know- 
ledge, best practices, and research. This paper gathers some information about risk communi- 
cations in emergency response, although this is recommended as a topic for future research. 
The literature suggests several basic characteristics for risk communication to the public as 
part of emergency response: communication should be clear and accurate, timely (ideally early), 
evidence-based [ideally with access to subject matter experts where appropriate}, and coordina- 
ted. 


Risk communication is yet another area for which good existing relationships and collaboration 
result in more effective emergency response. Several studies state prior EOC contact with media 
and journalists, as well as with the public, as important factors in successful communication 
during emergency response (29, 100, 1 72-1 74). Collaboration with other agencies is also a key 
factor, as coordinated messages allow for clearer public consumption of the information pre- 
sented (36, 172, 175). Canada’s Federal Public Communications Coordination Group formalizes 
this process, officially coordinating messages from all agencies to the media and the public (24). 


Clear, transparent, and accurate information is important in order to build trust with audiences 
(36, 48, 100, 176, 177]. The literature recommends being honest and forthcoming where pos- 
sible, and not conveying inaccurate information (48, 173). Tailoring information, especially highly 
scientific or technical information, to specific audiences can help align public perceptions with 
the messages conveyed (1 76). As Ng and Lean point out, successful risk communication means 
conveying "complex subject matter... in language that laypeople can understand" (177]. This can 
be accomplished by experts in linguistics and messaging. 


Several papers conclude that risk communication should be a component of emergency ope- 
rations plans (21, 36, 131, 178). Integrating communications staff into EOC activities such as 
daily briefings, planning, and trainings can create an atmosphere that facilitates information 
sharing in order to build foundations for communication with the public (174, 175, 178, 179). 
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Work done before an event occurs, such as establishing a relationship with journalists or the 
intended audience, conducting focus groups to determine what the public wants to see, and tes- 
ting sample messages, can facilitate effective risk communications during an event (131, 162, 
173-175, 177]. 


5.5 Operational information minimum data sets and standards 

Standards for data sources and common data sets are critical for successful EOC functioning 
and interoperability. Infrastructure, communication technology, and procedures and plans are 
the structures and foundations that enable operational information to be collected and analysed 
for decision-making and response. Data are collected from varied sources using tools such as 
the Community Assessment for Public Health Emergency Response (CASPEH] tool and - in 
some instances - mobile phones (180, 181). The surveillance systems collecting this informa- 
tion for EOCs are active before, during, and after an emergency, and are responsible for captu- 
ring data about population demographics, disease incidence and health status. During an emer- 
gency, it becomes important to collect data about healthcare system capacity, risk of disease 
spread, or post-disaster health status. EOCs collect standardised data during humanitarian res- 
ponses based on common operational data sets, and use standard information sources during 
foodborne disease outbreaks, both of which procedures are detailed below (125, 188, 183). 
Standards for minimum operational information data sets are outlined in the sections below and 
in Table 4. 


5.5.1 Information needs 


Information and data needs during EOC activation can vary widely. At the beginning of a response, 
needs assessments can help incident commanders and EOC leadership obtain situational awa- 
reness in order to manage the response and make decisions more effectively. These assess- 
ments may be done with the help of field personnel, designated assessment teams, and those 
in other sectors, such as healthcare professionals (8, 24, 41, 107, 146, 159, 170, 184-186]. 
Needs assessments can determine the scale of the emergency and the urgency of the neces- 
sary response (111). 


Several tools can be used to conduct needs assessments, such as CASPER, which uses statisti- 
cal and clustering methods to collect location, demographic, health status, and safety data about 
households and communities in the affected area (180). Results of needs assessments may be 
used within an EOC or disseminated to other jurisdictions and agencies, and the media or the 
public (107). Aung (70) notes not only that needs assessment results can be disseminated to 
others, but that data from other sources can also be added to one’s own data in order to form 
a Clearer picture of emergency responds needs and capabilities. The need for assistance from 
other jurisdictions can also be determined with the help of a needs assessment, as well as an 
assessment of the ability of the local community to respond to those needs (41). 


While surveillance systems were not specifically within the scope of this review, they are mentio- 
ned below as a potential topic for future research. They are also worth mentioning in the context 
of an assessment of the types of information and systems needed in an EOC environment. Sur- 
veillance that captures morbidity and mortality data, disease incidence, and population health 
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status data can be critical in determining situational awareness and making decisions about 
response (142). Pre-event data and trends are an important component of surveillance during 
an emergency response, as are data collected during the response. Even in areas where infras- 
tructure is destroyed or resources are scarce, surveillance systems using mobile phones can 
be used to collect some data in a standardised way (144, 181). The data collected and used by 
surveillance are discussed below. 


5.5.2 Types of operational information 


EOCs can use many types of information during emergency response. This information is needed 
"to support operations and decision-making for all actors" during emergency response (125). 
Epidemiologic data and assessments can provide crucial information about healthcare system 
capacity, risk of disease spread, or post-disaster health status (48, 68, 187). Baseline data 
collected before an emergency or disaster can be an important factor in the timeliness of a res- 
ponse. If baseline data are not available, resources otherwise used for response or relief efforts 
must be used to collect and analyse basic and geospatial data (182). Organizations like the UN 
and WHO are working to help Member States collect and improve their baseline data (182). 


The Inter-Agency Standing Committee (IASC) guidelines outline the types of information needed 
for humanitarian response, including humanitarian profile data, population statistics, geographic 
boundaries and places, transportation network data, and other geospatial information (125]. 
The OCHA standards for common operational data sets outline five similar categories of data 
(182, 183): 


1. Administrative boundaries include political and administrative boundaries used to organize 
and aggregate data 


2. Populated places data include the point location of cities, towns, and settlements 
3. Social infrastructure data include the point location of schools and health facilities 


4. Transportation information supports logistical planning and includes roads, rail lines, and 
airports 


5. Topographic data support mapping and spatial analysis. 


Optional data sets include marine, terrain, and natural hazard data, as well as maps and satellite 
imagery (182). 


5.5.3 Data sources, collection, and monitoring 


Information can be gathered from many sources for use in an EOC. These sources include but 
are not limited to EOC staff, other agencies, community members, and situation reports about 
the emergency or event (32). 


Data collection for EOC purposes during an event is difficult, but strengthening processes and 
systems before EOC activation can facilitate data collection and use during it (7O, 125). 


Data collection during response can be accomplished through direct observation, rapid assess- 
ment teams, health system data, population based surveys, and ongoing surveillance systems 
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(70, 188, 189). Site surveillance that relies on health system data can add to the data at an EOC 
(190). In the absence of resources or infrastructure, data can be collected in a non-technical but 
rapid manner if they are collected consistently and thoroughly; systems set up quickly based on 
needs during emergency response can still be effective for response and decision-making (181, 
191). 


Established global data sources and information networks can provide information for EOCs to 
use in determining response activities. EOCs activated for foodborne disease outbreaks can use 
the International Food Safety Authorities Network (INFOSAN) as a source of information about 
global food safety issues. Humanitarian disasters can use databases such as the Global Admi- 
nistrative Unit layers and Global Discovery. Metadata collected by Member States can also be 
shared through the GeoNetwork by end-users (182). It is also noted that national governments 
are further common sources of data, including geospatial and population data, as are academic 
institutions and commercial entities (36, 183). 


Monitoring information throughout emergency response can be used to make predictions about 
what is likely to happen next (48). Using and analysing information on how emergency response 
activities are being implemented and then determining what additional activities should be done 
and what resources they require are important roles of an EOC (48, 125). While some informa- 
tion used by EOCs can be gathered before an event, like census data, other information can be 
collected and updated throughout the response to help EOCs continually reassess emergency 
response activities (125). 


5.5.4 Use of operational information 


Knowledge management systems, discussed above, can be important sources of information 
from other parts of an EOC or from other agencies. They can also be helpful in pooling informa- 
tion and displaying it visually to help drive decision-making and action. Virtual EOCs, also discussed 
above, are another ICT innovation that can provide EOC staff with critical operational information 
during a response. 


Throughout EOC activation, the ongoing collection of information and its appropriate interpreta- 
tion can help EOC leaders maintain situational awareness in order to respond effectively (32, 48, 
146). EOC staff interpret and assess information collected at an EOC in order to determine its 
relevance, reliability, significance, and implications. Some papers recommend that staff should 
be trained using EOC standard data fields, and should follow standard procedures for perfor- 
ming this assessment (192, 193). After information has been appropriately processed, EOC lea- 
ders can react and respond by allocating resources, activating services and response activities, 
seeking outside assistance, and communicating as needed (24, 32). 


5.6 Training and exercises 

Training is “essential for [emergency operations plan] execution” (82) and a major element of 
many emergency response plans and standards (193-195). For example, FEMA coordinates 
trainings on Incident Command Systems and their components and awards credentials (25, 
43). Training and readiness is a required component of CDC funding for state and local health 
departments, and critical for Australian emergency management (198, 197). 
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One criticism of emergency response and EOC training is that the lack of standardisation (in the 
form of both competencies and curricula) and the lack of emphasis on evaluation or assessment 
call into question the effectiveness of training methods (196, 198). Individual and organizational 
training designed from an evidence base and including thorough assessment and evaluation can 
help ensure training is meeting its objectives and that individuals and organizations are prepared 
for emergency response (197-199). 


5.6.1 Individual training 


Training individuals in overall emergency response, as well as in specific functions and roles, is 
emphasized throughout the literature. Some papers also note the need for cross-functional and 
interagency training to enhance the ability of individuals to implement the components of com- 
munication and collaboration needed in EOC environments (34, 54, 108, 112, 200). Regardless 
of the need for both all-hazard and hazard-specific training in order to meet the respective needs 
of both an overall response and specific functions, due to resource constraints there is a wides- 
pread emphasis on all-hazard, overall training (37, 195, 196). 


Standards for individual training competencies are not consistent. There are some agreed-upon 
best practices for skills that individuals should have, and therefore be trained to do; these include 
but are not limited to recognizing threats and abnormal conditions; accessing and using commu- 
nication systems; conducting emergency operations planning; implementing specific resources, 
tools, and procedures; rapid assessment and surveillance; and basic familiarity with incident 
management systems or similar structures (54, 163, 179, 196, 201). Agreed-upon standards, 
competencies, and curricula are needed to ensure consistent training across jurisdictions and 
agencies (196, 198). 


Training for individual public health professionals can take the form of continuing education 
courses, government-sanctioned courses (e.g. FEMA certification), organizational exercises (dis- 
cussed in detail below), and on-the-job training (25, 80, 178). Training that includes a combina- 
tion of didactic and experiential learning techniques can involve individuals more fully in the skills 
being taught (34, 196). 


5.6.2 Organizational training and exercises 


The literature notes the importance of team and relationship building as one of the “primary 
purposes” of agency trainings (202). Improved communication, cooperation, and collaboration 
are all notable outcomes of high-quality training (107, 203). Joint training involving multiple agen- 
cies is mentioned consistently as an approach to building relationships and improving the likeli- 
hood of collaboration and coordination during responses to events (49, 60, 97, 204, 205). 


There are several types of agency trainings discussed in the literature. Different training formats 
achieve different objectives, and agencies may choose formats based on those objectives (53). 
Orientations and seminars familiarize participants with procedures, plans, and operational infor- 
mation. Drills help participants build, maintain, and evaluate specific skills. Tabletop exercises, 
hypotheticals/ scenarios, and workshops are informal ways in which to discuss hypothetical si- 
tuations and responses. Functional exercises simulate an EOG experience by presenting a situa- 


Systematic review of public health emergency operations centres 


tion in an interactive exercise with time constraints and limited available information. Full-scale 
exercises are the most extensive type of training by which to test a system comprehensively. 
Training can also take place in order to plan for known events, such as mass gatherings (18, 49, 
64, 113, 165, 195, 197, 208, 205). 


Exercises can assess an agency's communication and cooperation skills as well as the abilities of 
individuals to work with new or existing systems or equipment. These exercises help individuals 
become more competent with the systems; help agencies become better at using the systems 
as part of emergency response; and help expose any need for modifications or improvements to 
the systems themselves (70, 102, 120, 133, 204, 206). 


5.7 Themes and conclusions 

Major emergency events in the last two decades have caused authorities to modify emergency 
preparedness plans, resources, and approaches to emergency response. Many response ef- 
forts in this review, therefore, emphasized the need for robust planning and capacity and unders- 
cored the importance of Guarantelli's six basic EOC functions (15). As Kendra and Wachtendorf 
observe: 


"One key aspect of the response to the 11 September attack is that, although 
the EOC was destroyed, the emergency management organization was not. 
Rather, the organization itself exhibited robust, adaptive behavior, demonstrat- 
ing considerable improvisation, evidence of goal-directed solution-seeking and 
incorporating resources from diverse sources." (16) 


5.8 Limitations 

This systematic review included English-language studies only. To ensure that future research 
is robust, some non-English studies are listed in Attachment 2, the database of excluded stu- 
dies. While the authors consulted with several knowledge management specialists to refine the 
search strategy and review protocol, some literature may not have been included in the search 
results. There was a risk that the data extraction process could have been biased by potential 
inconsistencies in individual authors' use of terminology and language. 


Furthermore, the quality assessment process was limited by the types of studies included in the 
review and difficulty in assessing the quality of standards, guidelines, and requirements, especial- 
ly governmental documents. This weakness was addressed by changing the quality assessment 
denominator, but quantitatively assessing these types of articles remained challenging. 


This review's broad timeframe and the sensitivity of standards and guidelines, especially with 
respect to ICT, were limiting. Articles included from earlier in the review timeframe (i.e. closer to 
1993) referred to technologies of that time period but are now outdated. Often the principles, 
functions, and components of the article had stood the test of time, but specific technologies or 
hardware had not. 


In addition, major emergency events significantly altered public health emergency response, as 
well as many of the corresponding standards and best practices. The corresponding updating 
of standards, guidelines, and procedures did not always result in updated websites, especially at 
regional or local levels. 
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Finally, assumptions were made about best practices and guidelines. While some documents 
clearly stated requirements (e.g. funding prerequisites or independent organizational standards), 
others only laid out recommendations clearly intended as best practices and guidelines. Still 
others offered lessons learned and conclusions that aligned with those of others to become de 
facto best practices. By convention, a preference was maintained for documented standards, 
but de facto best practices seen repeatedly in the research, especially with regard to informal 
communication and coordination, were also included as lessons learned from emergency situa- 
tions. 
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6. Conclusion 


Public health EOCs are physical or virtual centres responsible for the strategic management of 
public health emergencies (1). EOCs provide support to on-scene response and relief activities. 
Although the format, structure, and size of individual EOCs vary widely, their role in public health 
emergency management and response is universally fundamental. 


6.1 Current status, gaps, and impediments in building, maintaining, 

and using EOCs 
Given the fast-changing political, environmental and social climate of today's world, EOCs must 
be adaptable and resilient in order to continue to provide effective emergency response. Listed 
below are descriptions of how EOGs currently function and the barriers to an improved response. 


6.1.1 EOC functions 


The requirement for communication and coordination was a central theme in the literature for 
effective EOC function across all variations in types of systems and software, EOC structures, ha- 
zards and risks, planning processes, activation criteria, risk communication strategies, and data 
collection approaches. The literature showed that the biggest barriers to EOC function were lack 
of sufficient communication and coordination. Other impediments existed, and adequate plan- 
ning was also an essential element, but communication and coordination within EOC sections, 
between EOCs, among agencies, and among jurisdictions consistently formed the basis for EOC 
SUCCESS, 


6.1.2 Standards 


Standards provide consistent guidelines or requirements for the building, maintenance, and use 
of EOCs. Standards produced help establish global criteria for emergency response facilities and 
equipment, business continuity programmes, data exchange, communication systems, incident 
management systems, risk management, assessment exercises, and responses to specific 
types of emergencies. 


6.1.3 Human resource needs 


The number of staff needed for a response varies by jurisdiction and according to elements 
of the emergency. Dedicated staff are necessary across EOC functions, in roles including lea- 
dership and management; operations; information management; logistics; media; safety and 
security; administration; technology support; and liaison positions. All staff should have clearly 
delineated roles and responsibilities. 


Surge staff are also needed for all EOC functions, and should be identified and trained in advance 
of a public health emergency. A major challenge posed by the use of surge staff is the fact that 
some public health professionals do not view themselves as emergency response personnel and 
are not prepared to be called upon to respond at any time. 
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6.1.4 Decision-making, modelling, and implementation 


With limited time and resources, rapid but accurate decision-making is extremely difficult. Pro- 
per preparedness and planning can be an important decision-making tool, but sufficient and 
accurate information is also required. In situations without adequate information, it was difficult 
to take action and prioritize scarce resources. Decision support systems and modelling can aid 
EOC leaders and decision makers in decision-making, and they can also take advantage of other 
tools and frameworks developed to assist situational analysis and aid decision-making. 


EOCs with standardised roles, a defined structure, and well-trained staff provide a formal pro- 
cess for taking action and create an environment in which necessary actions can be carried out. 


6.1.5 Communication technology and infrastructure 


The structure of an EOC should be well defined, standardised, scalable and flexible, and inter- 
connected with other levels and agencies. EOC personnel should be familiar with clear "trigger 
points" for decision-making, information sharing, or involving other jurisdictions. Many EOCs use 
an Incident Command System as an organizational structure. If an ICS is used, staff training is 
recommended in order to overcome documented challenges with ICS terminology and structure. 


The physical locations of EOCs vary, ranging from dedicated space to converted multi-purpose 
spaces to modular EOCs. Hegardless of location, EOCs should have certain standard compo- 
nents including communication systems; backup electrical and heating/ air conditioning systems; 
meeting rooms; a briefing space; and a staging area for air and land transportation. 


There is a wide range of ICT, software and hardware components, and systems that support 
EOC functions. These systems allow EOCs to collect, analyse, interpret, visualize, and disseminate 
information accurately and quickly. The ICT used in EOCs must be interoperable, reliable, modi- 
fiable, and have backups in place. In order to be interoperable, ICT must use common vocabulary 
and terminology, and staff must be trained and familiar with the systems. Lack of interoperability 
is a major challenge for the technology used in EOCs. Backup systems and redundancy and secu- 
rity requirements are critical for ensuring that EOCs remain functional even if initial systems have 
glitches or fail completely. 


6.1.8 Procedures and plans 


Emergenoy operations plans should be stated plainly. Well-written plans can result in timely and 
effective implementation of response activities. Having a plan does not, however, guarantee that 
an agency has achieved preparedness. Plans frequently use an all-hazards approach; but despite 
the popularity of the all-hazards approach, some literature cautions that plans should corres- 
pond to a jurisdiction's particular risks. 


Plans must, by definition, be developed in advance, and it is widely recommended that deve- 
lopment be both evidenced-based and a coordinated effort involving multiple stakeholders and 
parties. An emergency operations plan should have several standard components: the basic 
plan; functional annexes; hazard-specific appendices; and standard operating procedures and 
checklists. Plans should also include several other miscellaneous components: a map of the EOC 
layout; contact lists of EOC personnel; standard forms for documenting EOC activities; training 
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and exercise schedules and plans; and a section on de-activation and de-escalation procedures. 
All plans should also incorporate formal protocols for interacting with other agencies, jurisdic- 
tions, and sectors. 


6.1.7 Operational information minimum data sets and standards 


Standards for data sources and common data sets are critical for successful EOC function and 
interoperability. Data are collected from varied sources using a variety of tools. The surveillance 
systems collecting this information for EOCs are active before, during, and after an emergency 
and are responsible for capturing data about population demographics, disease incidence and 
health status. During an emergency, data about healthcare system capacity, risk of disease 
spread, or post-disaster health status become important to collect. 


Information can be gathered from many sources, including but not limited to EOC staff, other 
agencies, community members, and situation reports about the emergency or event. Strengthe- 
ning processes and systems before EOC activation can facilitate data collection and use during 
the event. Data collection during response can be accomplished through direct observation, 
deployment of rapid assessment teams, use of health system data, population based surveys, 
and ongoing surveillance systems. In the absence of resources or infrastructure data can be 
collected in a non-technical but rapid manner if they are collected consistently and thoroughly. 


6.1.8 Training and exercises 


Training is a major element of many emergency response plans and standards. One criticism of 
emergency response and EOC training is the lack of standardisation (in both competencies and 
curricula] and the lack of emphasis on evaluation or assessment. 


Individual and organizational training should be designed from an evidence base and include 
thorough assessment and evaluation to ensure that training meets its objectives and that indivi- 
duals and organizations are prepared for emergency response. 


Individuals should be trained in overall emergency response as well as in specific functions and 
roles. There are some agreed-upon best practices for training in skills that should be possessed 
by all EOC staff: recognizing threats and abnormal conditions; accessing and using communica- 
tion systems; emergency operations planning; implementing specific resources, tools, and pro- 
cedures; rapid assessment and surveillance; and basic familiarity with an incident management 
system or similar structures. 


There are several types of agency trainings: orientations and seminars; drills; tabletop exer- 
cises; hypotheticals/scenarios; workshops; functional exercises; and full-scale exercises. Trai- 
ning should include a combination of didactic and experiential learning techniques to in order to 
involve individuals fully in the skills being taught. These exercises help individuals become more 
competent with systems; help agencies become better at using those systems as part of emer- 
gency response; and can expose the need for modification or improvements to the systems 
themselves. 
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6.2 Global best practices for EOCs for effective public health emergency 
response 

This report listed current standards and guidelines in EOCs; summarized best practices and 

challenges in building, maintaining, and using EOCs; and identified existing performance indica- 

tors. These best practices are summarized in the following findings. 


ສ Use an Incident Command System (ICS) or similar structure to organize EOC operations 
and decision-making. 


m Delineate clear responsibilities and expectations for EOC staff and surge staff in all func- 
tions. 


m Use knowledge management software and information communication technology as ap- 
propriate for sufficient communication. Follow international messaging, privacy, and secu- 
rity standards. 


m Undertake a comprehensive planning process and create thorough plans, procedures, an- 
nexes, and other materials to facilitate EOC function during periods of activation. 


m Incorporate lessons learned from previous EOC responses in order to improve perfor- 
mance, while also working to meet and exceed existing governmental performance mea- 
sures. 


= = Implement data collection, analysis, and interpretation processes and systems to ensure 
EOCs have the information needed for decision-making and response. 


@ Conduct regular and objective-based trainings and exercises at both the individual and 
organizational levels to build skills, relationships, and the ability to respond effectively. 


6.3 The connection between EOCs and risk communication 
Risk communication is integrated throughout an EOCs' functions and activities. Accurate and 
timely information sharing that is evidence-based and coordinated is critical. Key points: 


ສ Build on existing relationships and collaborations with the media, other agencies, and stake- 
holders. 


W (Include risk communication and risk communication specialists in all aspects of emergency 
operations plans and EOC operations. 


6.4 Indicators to monitor EOC performance 

Several performance indicators can be used to measure success in EOC function, although clear 
agreement on indicators is not seen in the literature. The IHH lists indicators of its core response 
capacities, and some governmental agencies have developed competencies and indicators for 
measuring performance. The findings suggest adapting existing performance measures to indi- 
vidual EOC and agency use to self-assess performance and progress towards agency goals. 


6.5 Standardised EOC terminology 

This review found that EOCs have a variety of unstandardised names. Use of consistent language 
within an agency or jurisdiction can avoid confusing terms. Thus glossaries and lists of termino- 
logy should be included in emergency operations plans and trainings. 
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6.6 Research needs for building, maintaining, and using EOCs 
From the gaps in the literature, several areas were identified for future research. Gaps in evi- 
dence were identified and require future research. 


The field of risk communication is very broad and outside of the scope of this review. While some 
best practices were included, it is important to explore others more fully. 


Legal and ethical issues and concerns were continually indicated as important areas for consi- 
deration by jurisdictions when planning for and implementing emergency response. Examples of 
topics mentioned in various articles throughout the review included individual privacy concerns; 
jurisdictional coordination and the legal complexities thereof, and legislative solutions that facili- 
tated effective emergency response. 


Public health EOCs interact with public health and syndromic surveillance systems and with the 
healthcare sector at various points. These interactions are tangential to the specific objectives of 
this review, so they were not included in the scope of the review. They should, however, be noted 
as important components of overall public health emergency response. 


There are several review questions addressed in this report that are not fully answered by 
the literature. Solutions for surge capacity, the challenges of using information management 
software, EOC training programmes, and integrating risk communication into exercises are all 
considerations raised by this review but which are not fully addressed by the literature found in 
the systematic review process. 


As summarized in Section 6.2, several international standards need to be developed, including 
those which will outline: structures for organizing EOC operations and decision-making; clearly 
delineated roles and responsibilities for staff and surge staff, suitable knowledge management 
software and ICT in line with messaging, privacy, and security standards; data collection, analysis, 
and interpretation processes and systems; and consistent schedules and content for training 
and exercises. 


Finally, while the review covered many countries, jurisdictions, and types of populations, there are 
some that are underrepresented. The authors suspect that these areas, geographical or topical, 
do not have a presence in the peer-reviewed literature or prominent grey literature. Although 
they may be difficult to find, future research should make a specific point to seek out best prac- 
tices in these areas. 


As this review has shown, there are many tangible elements that go into making up an EOC, 
including procedures and plans; information and communication technology; and various types 
of systems, equipment and supplies. Underlying the many physical components of EOCs are EOC 
leaders and staff, and their interaction, communication, and collaboration in order to improve 
public health. 


Continuing to develop guidelines and standards in order to bring more uniformity and consis- 
tency to EOC functions and components can improve emergency response efforts. 
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8. Appendices 


8.1 List of review questions 


Review questions were grouped into five categories: 


1. General questions 

2. EOC communication technology and infrastructure 

3. Procedures and plans 

4. Operational information minimum data sets and standards 


5. Training and exercises. 


General questions: 


1. How are public health EOCs used? What are the core functions of public health EOCs? 
2. What are the risks and hazards that public health EOCs deal with? 


3. What models, best practices, and case studies exist on how risk communication is carried 
out in countries? 


4. How is risk communication integrated into EOC function? 


5. What are the key business processes (i.e. the common workflow of decision-making and 
implementation) in EOCs? 


6. What are the human resource needs for a functional EOC (telecommunications, operations 
manager, information management, situation analysis, logistics, operations, etc.]? 


7. What are solutions to surge capacity for an EOC during an emergency response/ crisis? 


8. What are the major challenges in building, maintaining, and using an EOC for public health 
emergency response? 


9. What indicators can be used or collected to describe and monitor a functional public health 
EOC? 


10. What regional, national, and international standards, good examples, or models exist re- 
lated to EOCs, including the four technical areas? 


11. What are the core components of the above standards? 


Communication technology and infrastructure: 


1. What equipment, technology, and infrastructure (hardware and software) are used in the 
EOC that deal with public health emergencies? 


2. What are the types of information management software used in the EOC? 


3. What are the challenges and gaps of using information management software in a public 
health EOC? 


4. What are the core components of equipment, technology, and infrastructure (hardware 
and software] of a public health EOC? 








5; 


6. 


World Health Organization 


What are the tools for a virtual EOC in the circumstance when a physical EOC is collapsed? 


What are the ICT problems associated with using an EOC for public health response? 


Procedures and plans: 


q; 


2: 


i 


8. 


Are there plans and procedures in place for risk communications? 


What international standards on public health emergency management procedures and 
plans exist? 


What are the common components in a public health emergency response plan? 


What are the barriers to complying with plans and procedures in public health emergency 
response or emergency management? 


What operating procedures and plans are used in a public health EOC? 
What criteria are used to determine EOC activating levels (i.e., partial or full activation]? 
What are the key common components in an EOC operating procedure/ plan? 


What are the barriers to complying with plans and procedures in an EOC? 


Operational information minimum data sets and standards: 


1. 


10. 


What are the information needs and challenges to the effective functioning of a public 
health EOC? 


What types of information are included in EOC operational information for public health 
emergency response in an “all hazards" approach (e.g., outbreaks or pandemics, bioweap- 
on or bioterrorism events, crises or disasters, chemical or nuclear events, or mass gather- 


ing]? 

What are the sources of operational information in a public health EOC? 

What is the role of an EOC in monitoring health emergency information? 

How is operational information used? 

What are the typical problems regarding collecting and using EOC operational information? 
What are the typical problems regarding data redundancies and duplication? 

How is risk communication messaging developed and disseminated from the EOC? 

What are the key components of risk communication information in a public health EOC? 


Is media and social media monitoring carried out systematically to gauge public concerns 
and fears, as part of the communications response? 


Training and exercise: 


T. 


2. 


What are the roles of an EOC in a public health response exercise? 
How is the EOC used for training staff for effective public health emergency response? 
What are the challenges of using an EOC for training and exercises? 


What EOC training programmes exist? What are the specific EOC's training programmes? 


Systematic review of public health emergency operations centres 


5. What are the core components for an effective EOC training programme? 


6. Is risk communications integrated into the health response exercises? 


8.2 Search strategy for each database searched 
See Tables 81-55. 





Table S1. PubMed search strategy 


Category 


Overall search 
terms 


General 





Search 
1 


2 


Terms 
(«Public Health Practice»[Mesh]) AND «Emergencies»[Mesh]) AND «Disaster Planning»[Mesh]) 


Public Health AND (Disasters OR Risk OR Civil Defense OR Disease Outbreaks OR Bioterrorism OR Chemical 
Safety OR Toxicology OR Radioactive Hazard Release OR Food Safety) AND («Emergency Operations Cen- 
ter» OR «Emergency Operations Centre» OR «Command and control operations center» OR «Command and 
control operations centre» OR «strategic health operations center» OR «strategic health operations centre» OR 
«Command center» OR «command centre» OR «Communication center» OR «Communication centre» OR «Di- 
saster management center» OR «Disaster management centre» OR «situation room» OR «crisis management 
center» OR «crisis management centre») 


Public Health AND (Disasters OR Risk OR Civil Defense OR Disease Outbreaks OR Bioterrorism OR Chemical 
Safety OR Toxicology OR Radioactive Hazard Release OR Food Safety) -- Keywords found below in 20-79 


((«Public Health Practice/organization and administration»[Mesh]))) AND (((((«Disaster Planning/methods»[Mesh] 
OR «Disaster Planning/organization and administration» [Mesh])) OR ((«Emergency Medical Services/organiza- 
tion and administration»|[Mesh] OR «Disease Outbreaks/organization and administration» [Mesh]))) OR («Civil 
Defense/organization and administration» [Mesh])) 


((Public health practice OR civil defense)) AND (((«Disaster Planning/methods»[Mesh] OR «Disaster Plan- 
ning/organization and administration»[Mesh]))) AND ((«Emergency Medical Services/organization and 
administration»[Mesh] OR «Disease Outbreaks/organization and administration» [Mesh])) 





((«Public Health Practice» |MESH]) AND «Disasters»[Mesh]) AND («Emergency Medical Services/organization 
and administration»[Mesh] OR «Disease Outbreaks/organization and administration»[Mesh] OR «Civil Defense/ 
organization and administration»[Mesh]) 

«Emergency Operations Centre» 

«Emergency Operations Center» AND Disaster Planning[MeSH] 

«Command and control operations center» 

«Command and control operations centre» 

«Strategic health operations center» 

«Strategic health operations centre» 

«Command center» 

«Command centre» 

«Communication center» 

«Communication centre» 

«Disaster management center» 

«Disaster management centre» 

«Situation room» 

«Emergency room» AND Disaster PlanningIMeSH] 

«Emergency center» AND Disaster Planning[MeSH] 

«Emergency center» AND Public Health[MeSH] 

«Emergency center» AND Public Health[MeSH] AND Disaster Planning[MeSH] 
«Emergency centre» AND Disaster Planning[MeSH] 

«Emergency centre» AND Public Health[MeSH] 

«Crisis management center» AND Public Health[MeSH] AND Disaster Planning[MeSH] 
«Crisis management centre» AND Public Health[MeSH] AND Disaster PlanningIMeSH] 
1-6 AND (Risk Management[MeSH] OR Risk Factors[MeSH]) 

1-6 AND Risk Communication 

1-6 AND Safety Management[MeSH] 

1-6 AND (Practice Guidelines as Topic[MeSH] OR Benchmarking[MeSH]) 

1-6 AND Organizational Case Studies[MeSH] 


1-6 AND (Health Communication[MeSH] OR Emergency Medical Service Communication Systems[MeSH] 
OR Communication[MeSH]) 


1-6 AND (Decision Making[MeSH] OR Decision Making, Organizational|MeSH]) 

1-6 AND (Health Plan Implementation[MeSH] OR Regional Health Planning[MeSH]) 
1-6 AND Organization and Administration|MeSH] 

1-6 AND Telecommunications[MeSH] 

1-6 AND Operations Research|MeSH] 

1-6 AND ((Surge Capacity[MeSH] OR Capacity Building[ MeSH]) OR Surge Capacity ) 
1-6 AND Epidemiological Monitoring[MeSH] 

1-6 AND (Guidelines as Topic[MeSH] OR Guideline Adherence[MeSH]) 

1-6 AND (Policy[MeSH] OR Organizational Policy[MeSH] OR Public Policy[MeSH] OR Policy Making[MeSH]}) 
1-6 AND Needs Assessment[MeSH] 

1-6 AND Health Resources[MeSH] 








Category Search Terms 








Information com- 45 1-6 AND Information Systems[MeSH] 
munication tech- 46 1-6 AND (Information Management[MeSH] OR Health Information Management[MeSH] OR Intergrated Ad- 
nology vanced Information Management Systems[MeSH]) 
47 1-6 AND (Text Messaging[MeSH] OR Internet|MeSH]) 
48 1-6 AND Telecommunications[MeSH] 
49 1-6 AND Software[MeSH] 
50 1-6 AND (Computers[MeSH] OR Technology[MeSH]) 
51 1-6 AND (Health Communication[MeSH] OR Emergency Medical Service Communication Systems[MeSH] 
OR Communication|MeSH]) 
52 1-6 AND Computer Communication Networks[MeSH] 
53 1-6 AND Information Science[MeSH] 
54 1-6 AND Organization and Administration|MeSH] 
55 1-6 AND User-Computer Interface[MeSH] 
56 1-6 AND Database Management Systems[MeSH] 
57 1-6 AND (Construction OR Infrastructure) 
Procedures and 58 Sil, C2, loy GIS), Se, dil a2 
plans 59 1-6 AND Standards 
60 1-6 AND (Terminology: OR Lexicon ) 
61 1-6 AND Methods 
Operational infor- 62 45, 46, 51, 54 
mation minimum 63 1-6 AND Operations Research[MeSH] 
5 64 1-6 AND (Decision Making[MeSH] OR Decision Making, Organizational|MeSH]) 
65 1-6 AND Epidemiological Monitoring[MeSH] 
66 1-6 AND Computer Security[MeSH] 
67 1-6 AND Interoperability 
68 1-6 AND (Minimum Data Sets: OR Data Elements ) 
69 1-6 AND (Information Content Standards) OR Standardization.) 
70 1-6 AND (Operating Procedures | OR Operations ` OR Logistics ) 
Training and 71 1-6 AND Education[MeSH] 
exercise 
72 1-6 AND Staff Development[MeSH] 
73 1-6 AND Education, Public Health Professional[MeSH] 
74 1-6 AND Professional Role|MeSH] 
75 1-6 AND Inservice Training[MeSH] 
76 1-6 AND Capacity Building[ MeSH] 
77 1-6 AND Training 
78 1-6 AND Human Resources 
79 1-6 AND Exercises 








Category 


Parallel search 
strategy 


denotes a keyword 


Search 


80 


81 


Terms 


(Centres[TIAB] OR Centers[TIAB] OR offices[TIAB] AND Centre[TIAB] OR Center[TIAB] OR office[TIAB] OR 
EOC[TIAB] OR room[TIAB] OR rooms[TIAB] OR facility[TIAB] OR facilities[TIAB]) AND («Disaster Planning/ 
methods»[Mesh] OR «Disaster Planning/organization and administration»|[Mesh] OR «Disaster Planning/ 
standards»[Mesh] OR «disaster planning»[TIAB] OR «disasters»[TIAB] OR «disease outbreak»[TIAB] OR 
«disease outbreaks»[TIAB] OR «Disease Outbreaks/legislation and jurisprudence»[Mesh] OR «Disease Out- 
breaks/organization and administration» [Mesh] OR pandemics[TIAB] OR epidemics[TIAB]) Filters: Abstract 
available; Publication date from 1993/01/01 to 2013/12/31; English NOT (((((«Public Health Practice»[Mesh]) 
AND «Emergencies»[Mesh] AND «Disaster Planning»[Mesh]) OR (Public Health AND (Disasters OR Risk 
OR Civil Defense OR Disease Outbreaks OR Bioterrorism OR Chemical Safety OR Toxicology OR Radioac- 
tive Hazard Release OR Food Safety) AND («Emergency Operations Center» OR «Emergency Operations 
Centre» OR «Command and control operations center» OR «Command and control operations centre» 
OR «strategic health operations center» OR «strategic health operations centre» OR «Command center» 
OR «command centre» OR «Communication center» OR «Communication centre» OR «Disaster manage- 
ment center» OR «Disaster management centre» OR «situation room» OR «crisis management center» OR 
«crisis management centre»)) OR ((((«Public Health Practice/organization and administration»[Mesh])) AND 
((((«Disaster Planning/methods»[Mesh] OR «Disaster Planning/organization and administration» [Mesh])) OR 
(«Emergency Medical Services/organization and administration» [Mesh] OR «Disease Outbreaks/organization 
and administration» [Mesh]))) OR («Civil Defense/organization and administration»[Mesh])))) OR (Public Health 
AND (Disasters OR Risk OR Civil Defense OR Disease Outbreaks OR Bioterrorism OR Chemical Safety OR 
Toxicology OR Radioactive Hazard Release OR Food Safety))) OR ((((public health practice OR civil defense))) 
AND ((((«Disaster Planning/methods»[Mesh] OR «Disaster Planning/organization and administration»[Mesh]))) 
AND ((«Emergency Medical Services/organization and administration» [Mesh] OR «Disease Outbreaks/orga- 
nization and administration»[Mesh])))) OR (((«Public Health Practice»|[MESH]) AND «Disasters»[Mesh]) AND 
(«Emergency Medical Services/organization and administration»[Mesh] OR «Disease Outbreaks/organization 
and administration»[Mesh] OR «Civil Defense/organization and administration» [Mesh])) 


«Crises Room»[TIAB] OR «crises rooms»[TIAB] OR «emergency operations centre»[TIAB] OR «emer- 
gency operation center»[TIAB] OR «situation room»[TIAB] OR «emergency operation centre»[TIAB] OR 
«emergency operations center»[TIAB] OR «National Emergency Operations Centre»[TIAB] OR «Nationale 
Alarmzentrale»[TIAB] OR «Centrale nazionale dall arme»[TIAB] OR «Centrale nationale d alarme»[TIAB] OR 
«National Disaster Management Center»[TIAB] OR Nationale Alarmzentrale AND «[TT] OR « AND Centrale 
nazionale dall arme AND «[TT] OR « AND Centrale nationale d alarme AND «[TT] OR < AND Emergency 
Operations Center AND «[TIAB] OR « AND Emergency Operations Centre AND «[TIAB] OR « AND «control 
operations center»[TIAB] OR «control operations centre»[TIAB] OR «strategic health operations center»[TIAB] 
OR «strategic health operations centre»[TIAB] OR «Command center»[TIAB] OR «command centre»[TIAB] OR 
«Communication center»[TIAB] OR «Communication centre»[TIAB] OR «Disaster management center»[TIAB] 
OR «Disaster management centre»[TIAB] OR «situation room»[TIAB] OR «crisis management center»[TIAB] 
OR «crisis management centre»[TIAB] Filters: Abstract available; Publication date from 1993/01/01 to 
2013/12/31; English NOT ((((((«Public Health Practice»[Mesh] AND «Emergencies»[Mesh]) AND «Disaster 
Planning»[Mesh]) OR (Public Health AND (Disasters OR Risk OR Civil Defense OR Disease Outbreaks OR 
Bioterrorism OR Chemical Safety OR Toxicology OR Radioactive Hazard Release OR Food Safety) AND 
(«Emergency Operations Center» OR «Emergency Operations Centre» OR «Command and control opera- 
tions center» OR «Command and control operations centre» OR «strategic health operations center» OR 
«strategic health operations centre» OR «Command center» OR «command centre» OR «Communication 
center» OR «Communication centre» OR «Disaster management center» OR «Disaster management centre» 
OR «situation room» OR «crisis management center» OR «crisis management centre»)) OR (((«Public Health 
Practice/organization and administration»[Mesh]))) AND (((((«Disaster Planning/methods»[Mesh] OR «Disas- 
ter Planning/organization and administration»[Mesh])) OR ((«Emergency Medical Services/organization and 
administration»[Mesh] OR «Disease Outbreaks/organization and administration»[Mesh]))) OR («Civil Defense/ 
organization and administration»[Mesh]))) OR (Public Health AND (Disasters OR Risk OR Civil Defense OR 
Disease Outbreaks OR Bioterrorism OR Chemical Safety OR Toxicology OR Radioactive Hazard Release OR 
Food Safety)) OR ((((public health practice OR civil defense)) AND ((((«Disaster Planning/methods»[Mesh] 
OR «Disaster Planning/organization and administration»[Mesh])) AND ((«Emergency Medical Services/orga- 
nization and administration»[Mesh] OR «Disease Outbreaks/organization and administration»[Mesh]))) OR 
(«Public Health Practice»[ MESH]) AND «Disasters»[Mesh]) AND («Emergency Medical Services/organization 
and administration»|[Mesh] OR «Disease Outbreaks/organization and administration»|[Mesh] OR «Civil De- 
fense/organization and administration»[Mesh])) 











Table S2. EMBASE search strategy 


Search 


1a 
1b 
2 


10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 


33 
34 


Terms 


Public health’/exp AND ‘emergency’/exp AND ‘disaster planning’/exp 
Public health'/exp AND (‘emergency’/exp OR ‘disaster’ /exp) 


Public health service’/exp AND (‘disaster’/exp OR ‘risk’/exp OR ‘civil defense’/exp OR ‘biological warfare’/ 
exp OR ‘hazard’/exp) 


Public health’/exp AND (‘disaster’/exp OR ‘risk’/exp OR ‘civil defense’/exp OR ‘epidemic’/exp OR ‘biological 
warfare’/exp OR ‘chemical safety’/exp OR ‘toxicology’/exp OR ‘nuclear accident’/exp OR ‘food safety’/exp) 


Public health practice’/exp AND (‘disaster planning’/exp OR ‘emergency’/exp OR ‘disease outbreaks’/exp 
OR ‘civil defense’) NOT ‘emergency department’ NOT ‘hospital’ 


Public health service’/exp OR ‘civil defense’/exp AND (‘disaster planning’/exp OR ‘emergency health ser- 
vice’/exp) 


(‘Public health service’/exp AND ‘disaster’/exp) AND (‘emergency health service’/exp OR ‘epidemic’/exp OR 
‘civil defense’/exp) 


«Emergency Operations Centre» 

«Emergency operations center» 

«Emergency Operations Center» AND «Disaster Planning» 
Command and control operations center 

Command and control operations centre 

Strategic health operations center NOT surgery 

Strategic health operations centre NOT surgery 
«Command center» 

«Command centre» 

«Communication center» 

«Communication centre» 

«Disaster management center» 

«Disaster management centre» 

«Situation room» 

«Emergency room» AND Disaster Planning 

«Emergency center» AND Disaster Planning 

Emergency center AND Public Health NOT hospital 
«Emergency center» AND Public Health AND Disaster Planning 


«Emergency centre» AND Disaster Planning 











«Emergency centre» AND Public Health NOT hospital 

«Crisis management center» AND Public Health AND Disaster Planning 
«Crisis management centre» AND Public Health AND Disaster Planning 
Public health'/exp AND ‘emergency’/exp AND ‘risk management’/exp 
Risk communication’ AND ‘public health’/exp 

Safety'/exp AND ‘public health'/exp AND ‘emergency’/exp 


Quality control’/exp OR ‘practice guideline’/exp AND ‘public health’/exp AND (‘emergency’/exp OR ‘disas- 
ter’/exp) 


Public health service’/exp AND ‘disaster planning’/exp 


Public health service’/exp AND ‘emergency health service’/exp NOT ‘emergency department’ 





Terms 


Search 


36 


37 


38 
39 
40 
41 
42 
43 
44 
45 


46 
47 


48 


49 


50 


51 
52 


(‘System analysis'/exp OR ‘epidemiological monitoring’/exp OR ‘computer security'/exp) AND (‘public health'/exp 


AND (disaster /exp OR ‘risk’/exp OR ‘civil defense’/exp OR ‘epidemic’/exp OR ‘biological warfare’/exp OR 'chemi- 
cal safety’/exp OR ‘toxicology’/exp OR ‘nuclear accident'/exp OR ‘food safety'/exp)) 


System analysis'/exp OR 'epidemiological monitoring'/exp OR 'computer security'/exp AND 'public health'/exp 


1a AND «Information System» 
1b AND «Information System» 
2 AND «Information System» 
3 AND «Information System» 
4 AND «Information System» 
5 AND «Information System» 








6 AND «Information System» 
(1a OR 1b OR 2 OR 4 OR 5 OR 6) AND (‘computer OR ‘computer interface’ OR ‘computer program’) 


(1a OR 1b OR 2 OR 4 OR 5 OR 6) AND ('technology' OR ‘communication software’) 

(1a OR 1b OR 2 OR 4 OR 5 OR 6) AND (‘database’ OR ‘medical information system’ OR ‘medical information’) 

(1a OR 1b OR 2 OR 4 OR 5 OR 6) AND (‘communication protocol’ OR ‘emergency health service facilitated com- 
munication’ OR ‘mass communication’) 


(1a OR 1b OR 2 OR 4 OR 5 OR 6) AND ('education' OR ‘medical education’ OR ‘vocational education’ OR 'educa- 
tion program’ OR ‘emergency medical services education’) 


(1a OR 1b OR 2 OR 4 OR 5 OR 6) AND (‘staff training’ OR ‘In service training’ OR ‘capacity building’) 





(1a OR 1b OR 2 OR 4 OR 5 OR 6) AND (‘personnel management’ OR ‘professional standard’) 
(1a OR 1b OR 2 OR 4 OR 5 OR 6) AND («human resources») 




















Table S3. Web of Science search strategy 





Search Terms 

1 «Public health» AND emergency AND «disaster planning» 

2 Public health'/exp AND (‘emergency’/exp OR ‘disaster’/exp) 

3 Public health AND preparedness 

4 Public health service’/exp AND (‘disaster’/exp OR 'risk'/exp OR ‘civil defense'/exp OR ‘biological warfare’/exp OR 
‘hazard’/exp) 

5 Public health’/exp AND (‘disaster’/exp OR ‘risk’/exp OR ‘civil defense’/exp OR ‘epidemic’/exp OR ‘biological warfare’/ 
exp OR ‘chemical safety’/exp OR ‘toxicology’/exp OR ‘nuclear accident’/exp OR ‘food safety’/exp) 

6 Public health practice’/exp AND (‘disaster planning’/exp OR ‘emergency’/exp OR ‘disease outbreaks’/exp OR ‘civil 
defense’) NOT ‘emergency department’ NOT ‘hospital’ 

7 Public health service’/exp OR ‘civil defense’/exp AND (‘disaster planning’/exp OR ‘emergency health service’/exp) 

8 (‘Public health service’/exp AND ‘disaster’/exp) AND (‘emergency health service’/exp OR ‘epidemic’/exp OR ‘civil 
defense’/exp) 

9 «Emergency Operations Centre» 

10 «Emergency operations center» 

11 «Emergency Operations Center» AND Disaster Planning 

12 Command and control operations center 

13 Command and control operations centre 

14 Strategic health operations center 

15 Strategic health operations centre 

16 Command center AND public health 

17 «Command centre» 

18 (Communication center AND public health) AND (emergency or disaster) 

19 «Communication centre» 

20 «Disaster management center» 

21 «Disaster management centre» 

22 «Situation room» 

23 «Emergency room» AND Disaster Planning 

24 «Emergency center» AND Disaster Planning 

25 Emergency center AND Public Health 

26 «Emergency center» AND Public Health AND Disaster Planning 

27 «Emergency centre» AND Disaster Planning 

28 «Emergency centre» AND Public Health NOT hospital 

29 «Crisis management center» AND Public Health AND Disaster Planning 

30 Crisis management center 

31 «Crisis management centre» AND Public Health AND Disaster Planning 

32 «Public health» AND emergency AND «risk management» 

33 Risk communication AND public health 

34 Risk communication AND public health AND emergency 

35 Public health AND preparedness AND guideline 

36 Public health AND preparedness AND standard 

37 «Public health emergency» AND «training» 

38 «Public health disaster» AND «training» 

39 «Public health emergency» AND «technology» 

40 «Public health disaster» AND «technology» 

41 «Public health emergency» AND «communication» 


42 «Public health disaster» AND «communication» 





Table S4. IEEEXplore search strategy 


Search 


ລ O NOORA ON ch 





Terms 

Incident command center 

Public health disaster 

Public health emergency 

Public health emergency communication 
Public health emergency data 

Public health emergency equipment 

Public health emergency functions 

Public health emergency information management 
Public health emergency infrastructure 
Public health emergency international 

Public health emergency management 
Public health emergency management plan 
Public health emergency model 

Public health emergency operation 

Public health emergency operation center 
Public health emergency plan 

Public health emergency protocol 

Public health emergency response 

Public health emergency risk communication 
Public health emergency software 

Public health emergency staff 

Public health emergency standards 

Public health emergency surge capacity 
Public health emergency technology 

Public health emergency telecommunication 
Public health emergency training 

Public health preparedness 

Public health response 

Public health response challenge 


Virtual emergency operation center 


Table S5. ACM search strategy 


Public health emergency 
Public health response 
Public health preparedness 
Emergency operation center 
Emergency preparedness 


Public health preparedness AND emergency response 


K OOA QORN = 


Public health emergency AND response 











8.3 Additional studies, standards and other materials included in review 


10. 


11. 


12. 


13. 


14. 


15. 


Arora H, Raghu TS, Vinze A, editors. Optimizing Regional Aid during Public Health Emer- 
gencies: An Autonomic Resource Allocation Approach. System Sciences, 2007 HICSS 
2007 40th Annual Hawaii International Conference on; 2007 Jan. 2007. 


Baciu F, Buglova E, Martincic R, Spiegelberg Planer R, Stern W, Winkler G. Incident and 
Emergency Centre of the IAEA. Health Phys. 2010;98(6):779-83. Epub 2010/05/07. doi: 
10.1097/HP.0b013e3181b977e4. PubMed PMID: 20445379. 


Belgian Working Group on Influenza A(H1N1)v. Influenza A(H1N1)v virus infections in 
Belgium, May-June 2009. Euro Surveill. 2009;14(28). Epub 2009/07/18. PubMed PMID: 
19607783. 


Benjamin E, Bassily-Marcus AM, Babu E, Silver L, Martin ML. Principles and practice of 
disaster relief: lessons from Haiti. Mt Sinai J Med. 2011;78(3):306-18. Epub 2011/05/21. 
doi: 10.1002/msj.20251. PubMed PMID: 21598258. 


Berkowitz MR. High-level specification of a proposed information architecture for sup- 
port of a bioterrorism early-warning system. South Med J. 2013;106(1):31-6. Epub 
2012/12/25. doi: 10.1097/SMJ.0b013e31827ca83c. PubMed PMID: 23263311. 


Bermejo PM. Preparation and response in case of natural disasters: Cuban programs 
and experience. Journal of Public Health Policy. 2006;27(1):13-21. 


Brandeau ML, Zaric GS, Freiesleben J, Edwards FL, Bravata DM. An ounce of preven- 
tion is worth a pound of cure: improving communication to reduce mortality during bio- 
terrorism responses. Am J Disaster Med. 2008;3(2):65-78. Epub 2008/06/05. PubMed 
PMID: 18522248. 


Calixto E, Larouvere EL. The regional emergency plan requirement: Application of the 
best practices to the Brazilian case. Safety Science. 2010;48(8):991-9. 


Caro DH. Towards integrated crisis support of regional emergency networks. Health Care 
Manage Rev. 1999;24(4):7-19. Epub 1999/11/26. PubMed PMID: 10572784. 


Carr Z. WHO-REMPAN for global health security and strengthening preparedness and 
response to radiation emergencies. Health Phys. 2010;98(6):773-8. Epub 2010/05/07. 
doi: 10.1097/HP.0b013e3181bbc18b. PubMed PMID: 20445378. 


Castro-Jimenez MA, Vera-Cala LM, Rey-Benito GJ. The situation room: a step by step 
procedure toward pandemic influenza preparedness. J Infect Dev Ctries. 2009;3(9):649- 
53. Epub 2009/10/28. PubMed PMID: 19858564. 


Chan YF, Alagappan K, Gandhi A, Donovan C, Tewari M, Zaets SB. Disaster man- 
agement following the Chi-Chi earthquake in Taiwan. Prehosp Disaster Med. 
2006;21(3):196-202. Epub 2006/08/09. PubMed PMID: 16892885. 


Cleveland K, Keim M, Rich W, Rhyne G. Pilot workshops at the Palau Center for Emer- 
gency Health: a model for international collaborative operations training and planning. 
Pac Health Dialog. 2002;9(1):7-10. Epub 2003/05/10. PubMed PMID: 12737410. 


Covich JR, Parker CL, White VA. The Practice Community Meets the Ivory Tower: A 
Health Department/Academic Partnership to Improve Public Health Preparedness. Public 
Health Reports. 2005;120(SUPLL. 1):84-90. 


Craig AT, Kasai T, Li A, Otsu S, Khut QY. Getting back to basics during a public health 
emergency: a framework to prepare and respond to infectious disease public health 
emergencies. Public Health. 2010;124(1):10-3. Epub 2009/12/26. doi: 10.1016/. 
puhe.2009.11.011. PubMed PMID: 20034644. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 


25. 


26. 


27. 


28. 


29. 


30. 


31. 


Fruhling A, Sambol A, Hinrichs S, de Vreede G, editors. Designing an Emergency Re- 
sponse System for Electronic Laboratory Diagnostics Consultation. System Sciences, 
2006 HICSS '06 Proceedings of the 39th Annual Hawaii International Conference on; 
2006 04-07 Jan. 2006. 


Gan J-F, Li Q, Qu Y-Z, editors. Public health emergency management system framework 
based on digital city. Geoscience and Remote Sensing Symposium, 2005 IGARSS '05 
Proceedings 2005 IEEE International; 2005 25-29 July 2005. 


Gautman K. Organizational problems faced by the Missouri DOH in providing disas- 
ter relief during the 1993 floods. J Public Health Manag Pract. 1998;4(4):79-86. Epub 
1998/06/06. PubMed PMID: 10186763. 


Gebbie KM, Horn L, McCollum M, Ohara K. Building a system for preparedness: 
The Nycepce nest experience. Journal of Public Health Management and Practice. 
2009;15(SUPPL. 2):S3-S7. 


Goddard NL, Delpech VC, Watson JM, Regan M, Nicoll A. Lessons learned from SARS: 
the experience of the Health Protection Agency, England. Public Health. 2006;120(1):27- 
32. Epub 2005/11/22. doi: 10.1016/j.puhe.2005.10.003. PubMed PMID: 16297417. 


Grantmakers in Health. Strengthening the public health system for a healthier future. 
Washington, D.C.: 2003 Feb. Report No.: 1559-5609 Contract No.: 17. 


Harrison JP, Harrison RA, Smith M. Role of information technology in disaster medical 
response. Health Care Manag (Frederick). 2008;27(4):307-13. Epub 2008/11/18. doi: 
10.1097/HCM.0b013e31818b95c7. PubMed PMID: 19011412. 


Hu G, Rao K, Hu M, Sur Z. Preparing for and responding to public health emergencies in 
China: a focus group study. J Public Health Policy. 2007;28(2):185-95. Epub 2007/06/23. 
doi: 10.1057/palgrave.jphp.3200130. PubMed PMID: 17585319. 


Hu J, Zeng AZ, Lindu Z, editors. A Comparative Study of the Public Health Emergency 
Management Mechanisms between US and China. Bioinformatics and Biomedical Engi- 
neering , 2009 ICBBE 2009 3rd International Conference on; 2009 11-13 June 2009. 


International Atomic Energy Agency. Manual for First Responders to a Radiological 
Emergency. In: Centre laE, editor. Vienna, Austria: International Atomic Energy Agency; 
2006. 


International Federation of Red Cross and Red Crescent Societies. Introduction to the 
Guidelines for the domestic facilitation and regulation of international disaster relief and 
initial recovery assistance. Geneva: 2011. 


Jaeger PT, Shneiderman B, Fleischmann KR, Preece J, Qu Y, Wu PF. Community re- 
sponse grids: E-government, social networks, and effective emergency management. 
Telecommun Policy. 2007;31(10-11):592-604. doi: 10.1016/j.telpol.2007.07.008. 


Jarrett D. Lessons learned: the "pale horse" bioterrorism response exercise. Disaster 
Manag Response. 2003;1(4):114-8. Epub 2003/12/11. doi: 10.1016/j.dmr.2003.08.001. 
PubMed PMID: 14666097. 


Kendal AP, MacDonald NE. Influenza Pandemic Planning and Performance in Cana- 
da, 2009. Canadian Journal of Public Health-Revue Canadienne De Sante Publique. 
2010;101(6):447-53. PubMed PMID: WOS:000286964800006. 


Koplan ປ. CDC’s strategic plan for bioterrorism preparedness and response. Pub- 
lic Health Rep. 2001;116 Suppl 2:9-16. Epub 2002/03/07. PubMed PMID: 11880662; 
PubMed Central PMCID: PMCPmc1497264. 


Lee ACK, Phillips W, Challen K, Goodacre S. Emergency management in health: key is- 
sues and challenges in the UK. Bmc Public Health. 2012;12:11. doi: 10.1186/1471-2458- 
12-884. PubMed PMID: WOS:000315221100001. 








32. 


33. 


34. 


35. 


36. 


37. 


38. 


39. 


40. 


41. 


42. 


43. 


44. 


45. 


46. 


Lei BL, Zhou Y, Zhu Y, Huang XY, Han SR, Ma Q, et al. Emergency response and medi- 
cal rescue in the worst hit Mianyang areas after the Wenchuan earthquake. J Evid 
Based Med. 2008;1(1):27-36. Epub 2008/11/01. doi: 10.1111/].1756-5391.2008.00012.x. 
PubMed PMID: 21348973. 


Li J, Ray P, editors. Applications of E-Health for pandemic management. e-Health Net- 
working Applications and Services (Healthcom), 2010 12th IEEE International Confer- 
ence on; 2010 1-3 July 2010. 


Lichtveld M, Hodge JG, Jr., Gebbie K, Thompson FE, Jr., Loos DI. Preparedness on the 
frontline: what's law got to do with it? J Law Med Ethics. 2002;30(3 Suppl):184-8. Epub 
2003/01/02. PubMed PMID: 12508524. 


Liu Y, Lei C, Qin B, Chen H, Su X. Medical preparedness for Radiation Emergency for 
the Olympic Games, Beijing 2008. Health Phys. 2010;98(6):784-7. Epub 2010/05/07. doi: 
10.1097/HP.0b0136e3181b182dc. PubMed PMID: 20445380. 


Maciejewski R, Livengood P, Rudolph S, Collins TF, Ebert DS, Brigantic RT, et al. A pan- 
demic influenza modeling and visualization tool. J Vis Lang Comput. 2011;22(4):268-78. 
doi: 10.1016/.jvlc.2011.04.002. 


Mann NC, MacKenzie E, Anderson C. Public health preparedness for mass-casualty 
events: a 2002 state-by-state assessment. Prehosp Disaster Med. 2004;19(3):245-55. 
Epub 2004/12/02. PubMed PMID: 15571201. 


Markenson D, Reilly MJ, DiMaggio C. Public health department training of emergency 
medical technicians for bioterrorism and public health emergencies: Results of a na- 
tional assessment. Journal of Public Health Management and Practice. 2005:S68-S74. 
PubMed PMID: WOS:000232725800012. 


McKenna T, Buglova E, Kutkov V. Lessons learned from Chernobyl and other emergen- 
cies: establishing international requirements and guidance. Health Phys. 2007;93(5):527- 
37. Epub 2007/12/01. doi: 10.1097/01.HP.0000281176.42257.b8. PubMed PMID: 
18049230. 


Militello L, Patterson ES, Bowman L, Wears R. Information flow during crisis manage- 
ment: challenges to coordinate in the emergency operation center. Cogn Tech Work. 
2007;9:25-31. 


Miller CW, McCurley MC. Federal interagency communication strategies for addressing 
radiation emergencies and other public health crises. Health Phys. 2011;101(5):559-61. 
Epub 2011/10/08. doi: 10.1097/HP.0b013e31822552d7. PubMed PMID: 21979540. 


Mothershead JL, Tonat K, Koenig KL. Bioterrorism preparedness. Ill: State and fed- 
eral programs and response. Emerg Med Clin North Am. 2002;20(2):477-500. Epub 
2002/07/18. PubMed PMID: 12120488. 


Mott JA, Treadwell TA, Hennessy TW, Rosenberg PA, Wolfe MI, Brown CM, et al. Call- 
tracking data and the public health response to bioterrorism-related anthrax. Emerg In- 
fect Dis. 2002;8(10):1088-92. Epub 2002/10/25. doi: 10.3201/eid0810.020355. PubMed 
PMID: 12396921; PubMed Central PMCID: PMCPmc2730299. 


Murray V, Goodfellow F. Mass casualty chemical incidents - Towards guidance for public 
health management. Public Health. 2002;116(1):2-14. 


Neal DM, Phillips BD. Effective emergency management: reconsidering the bureaucratic 
approach. Disasters. 1995;19(4):327-37. Epub 1995/12/01. PubMed PMID: 8564456. 


Polyak CS, Macy JT, Irizarry-De La Cruz M, Lai JE, McAuliffe JF, Popovic T, et al. 
Bioterrorism-related anthrax: international response by the Centers for Disease Control 
and Prevention. Emerg Infect Dis. 2002;8(10):1056-9. Epub 2002/10/25. doi: 10.3201/ 
eid0810.020345. PubMed PMID: 12396915; PubMed Central PMCID: PMCPmc2730286. 


47. 


48. 


49. 


50. 


51. 


52. 


53. 


54. 


55. 


56. 


57. 


58. 


59. 


60. 


61. 


Preparedness, LLC. Emergency Management and Business Continuity Program Evalua- 
tion Checklist. Sharon, MA: Preparedness, LLC, 2009. 


Quiram BJ, Carpender K, Pennel C. The Texas Training Initiative for Emergency Re- 
sponse (T-TIER): an effective learning strategy to prepare the broader audience of 
health professionals. J Public Health Manag Pract. 2005;Suppl:S83-9. Epub 2005/10/06. 
PubMed PMID: 16205549. 


Raber E, Hirabayashi JM, Mancieri SP, Jin AL, Folks KJ, Carlsen TM, et al. Chemical 
and biological agent incident response and decision process for civilian and public sector 
facilities. Risk Analysis. 2002;22(2):195-202. 


Reeder B, Turner AM. Scenario-based design: A method for connecting information 
system design with public health operations and emergency management. Journal of 
Biomedical Informatics. 2011;44(6):978-88. 


Rodrigo T, Cayla J. Public health crises: the development of a consensus document 
on their management in Spain. Euro Surveill. 2011;16(15). Epub 2011/04/22. PubMed 
PMID: 21507319. 


Roth LH, Criss K, Stewart X, McCann K. PrepLink: a novel web-based tool for health- 
care emergency planning and response. Biosecur Bioterror. 2009;7(1):85-91. Epub 
2009/04/22. doi: 10.1089/bsp.2008.0052. PubMed PMID: 19379107. 


Seidl IA, Johnson AJ, Mantel P, Aitken P. A strategy for real time improvement (RTI) in 
communication during the H1N1 emergency response. Aust Health Rev. 2010;34(4):493- 
8. Epub 2010/11/27. doi: 10.1071/ah09826. PubMed PMID: 21108912. 


Seyedin H, Ryan J, Sedghi S. Lessons learnt from the past and preparedness for 

the future: how a developing country copes with major incidents. Emerg Med J. 
2011;28(10):887-91. Epub 2010/10/15. doi: 10.1136/emj.2009.090555. PubMed PMID: 
20943839. 


Shobayashi T. Japan's actions to combat pandemic influenza (A/H1N1). Japan Medical 
Association Journal. 2011;54(5):284-9. 


Simpson J. The Role of Exercises in Pandemic Preparedness. In: Van-Tam J, editor. 
Pandemic Influenza2013. 


Sobers-Grannum N, Springer K, Ferdinand E, St John J. Response to the challenges of 
pandemic H1N1 in a small island state: the Barbadian experience. BMC Public Health. 
2010;10 Suppl 1:810. Epub 2010/12/22. doi: 10.1186/1471-2458-10-s1-s10. PubMed 
PMID: 21143820; PubMed Central PMCID: PMCPmc3005570. 


Stark C, Garman E, McMenamin J, McCormick D, Oates K. Major incidents in rural ar- 
eas: managing a pandemic A/H1N1/2009 cluster. Rural Remote Health. 2010;10(3):1413. 
Epub 2010/08/13. PubMed PMID: 20701414. 


Stern AM, Koreck MT, Markel H. Assessing Argentina's response to H1N1 in aus- 

tral winter 2009: from presidential lethargy to local ingenuity. Public Health Rep. 
2011;126(1):9-12. Epub 2011/02/23. PubMed PMID: 21337926; PubMed Central PMCID: 
PMCPmc3001827. 


Stone G, Lekht A, Burris N, Williams C. Data collection and communications in the 
public health response to a disaster: rapid population estimate surveys and the Daily 
Dashboard in post-Katrina New Orleans. J Public Health Manag Pract. 2007;13(5):453- 
60. Epub 2007/09/01. doi: 10.1097/01.PHH.0000285196.16308.7d. PubMed PMID: 
17762688. 


Tan CM, Barnett DJ, Stolz AJ, Links JM. Radiological incident preparedness: plan- 
ning at the local level. Disaster Med Public Health Prep. 2011;5 Suppl 1:ຣ151-8. Epub 
2011/03/22. doi: 10.1001/dmp.2011.11. PubMed PMID: 21402808. 








62. 


63. 


64. 
65. 


66. 


67. 


68. 


69. 


70. 


71. 


72. 


73. 


TA. 


75. 
76. 


77. 


78. 


79. 


Tarantino D. Asian tsunami relief: Department of Defense public health response: Policy 
and strategic coordination considerations. Military Medicine. 2006;171(10 SUPPL.):15-8. 


Thackway SV, McAnulty JM. Pandemic (H1N1) 2009 influenza in NSW. N S W Public 
Health Bull. 2010;21(1-2):1-3. Epub 2010/05/11. PubMed PMID: 20449937. 


The InterAgency Board. List of IAB Adopted Standards. The InterAgency Board; 2013. p. 4. 


Turoff M, Chumer M, Starr Roxanne H, Klashner R, et al. ASSURING HOMELAND SE- 
CURITY: CONTINUOUS MONITORING, CONTROL & ASSURANCE OF EMERGENCY 
PREPAREDNESS. JITTA : Journal of Information Technology Theory and Application. 
2004;6(3):1-24. PubMed PMID: 200008540. 


U.S. Centers for Disease Control and Prevention. CDC Dedicates New Marcus Emer- 
gency Operations Center. State-of-the-art facility strengthens agency’s response to 
health crises. 2003. 


U.S. Centers for Disease Control and Prevention. Public Health Preparedness: 2012 
State-By-State Report on Laboratory, Emergency Operations Coordination, and Emer- 
gency Public Information and Warning Capabilities. 2012. 


U.S. Department of Homeland Security. National Incident Management System. In: U.S. 
Department of Homeland Security, editor. Washington, D.C.: U.S. Department of Home- 
land Security; 2008. 


U.S. Federal Emeergency Management Agency. National Incident Management (NIMS) 
Preparedness and Incident Management Standards. U.S. Federal Emergency Manage- 
ment Agency; 2008. 


U.S. Federal Emeergency Management Agency. National Incident Management System 
(NIMS) Communication and Information Management Standards. U.S. Federal Emer- 
gency Management Agency; 2008. 


Waugh W. Collaboration and Leadership for Effective Emergency Management. Public 
Administration Review. 2006;66(s1):131-40. doi: 10.1111/j.1540-6210.2006.00673.x. 


World Health Organization. Fifth Futures Forum on Rapid Response Decision-Making 
Tools. Madrid, Spain: World Health Organization, 2004. 


World Health Organization. Global Alert and Response (GAR): Guiding Principles for 
International Outbreak Alert and Response: World Health Organization; 2013 [updated 
2013-10-14 16:42:06]. Available from: http://www.who.int/csr/outbreaknetwork/guiding- 
principles/en/. 


World Health Organization. IHR Procedures concerning public health emergencies of in- 
ternational concern (PHEIC): World Health Organization; [updated 2013-11-01 10:59:24; 
cited 2013]. Available from: http://www.who.int/ihr/procedures/pheic/en/. 


World Health Organization. International Health Regulations (2005). Geneva: 2008. 


World Health Organization. International Health Regulations: A guide for public health 
emergency contingency planning at designated points of entry. World Health Organiza- 
tion, 2012 Contract No.: 978 92 9061 566 8. 


World Health Organization. Meeting the Challenge of Future Epidemic Emergencies. 
1996. 


World Health Organization. Response: World Health Organization; [cited 2013]. Avail- 
able from: http://www.euro.who.int/en/health-topics/emergencies/disaster-preparedness- 
and-response/policy/response. 


Yusof MA, Ali HM. Radiological emergency: Malaysian preparedness and response. 
Radiat Prot Dosimetry. 2011;146(1-3):38-41. Epub 2011/07/07. doi: 10.1093/rpd/ncr102. 
PubMed PMID: 21729940. 


y World Health 
Organization 


2 


=> 





Js; 
<a 


LY 0¢/d99/4SH/OHM 


